Aug 16 08:04:13 user nova-compute[73091]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 16 08:04:16 user nova-compute[73091]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73091) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73091) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73091) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 08:04:16 user nova-compute[73091]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:04:16 user nova-compute[73091]: INFO nova.virt.driver [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 16 08:04:16 user nova-compute[73091]: INFO nova.compute.provider_config [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] Acquiring lock "singleton_lock" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] Acquired lock "singleton_lock" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] Releasing lock "singleton_lock" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] Full set of CONF: {{(pid=73091) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ******************************************************************************** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] Configuration options gathered from: {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ================================================================================ {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] allow_resize_to_same_host      = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] arq_binding_timeout            = 300 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] backdoor_port                  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] backdoor_socket                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] block_device_allocate_retries  = 300 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] block_device_allocate_retries_interval = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cert                           = self.pem {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] compute_monitors               = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] config_dir                     = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] config_drive_format            = iso9660 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] config_source                  = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] console_host                   = user {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] control_exchange               = nova {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cpu_allocation_ratio           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] daemon                         = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] debug                          = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] default_access_ip_network_name = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] default_availability_zone      = nova {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] default_ephemeral_format       = ext4 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] default_schedule_zone          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] disk_allocation_ratio          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] enable_new_services            = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] enabled_ssl_apis               = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] flat_injected                  = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] force_config_drive             = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] force_raw_images               = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] graceful_shutdown_timeout      = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] heal_instance_info_cache_interval = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] host                           = user {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] instance_build_timeout         = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] instance_delete_interval       = 300 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] instance_name_template         = instance-%08x {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] instance_usage_audit           = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] instance_usage_audit_period    = month {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] internal_service_availability_zone = internal {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] key                            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] live_migration_retry_count     = 30 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] log_config_append              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] log_dir                        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] log_file                       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] log_options                    = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] log_rotate_interval            = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] log_rotate_interval_type       = days {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] log_rotation_type              = none {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] long_rpc_timeout               = 1800 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] max_concurrent_builds          = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] max_concurrent_live_migrations = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] max_concurrent_snapshots       = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] max_local_block_devices        = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] max_logfile_count              = 30 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] max_logfile_size_mb            = 200 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] maximum_instance_delete_attempts = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] metadata_listen                = 0.0.0.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] metadata_listen_port           = 8775 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] metadata_workers               = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] migrate_max_retries            = -1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] mkisofs_cmd                    = genisoimage {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] my_ip                          = 10.0.0.210 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] network_allocate_retries       = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] osapi_compute_listen_port      = 8774 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] osapi_compute_unique_server_name_scope =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] osapi_compute_workers          = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] password_length                = 12 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] periodic_enable                = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] periodic_fuzzy_delay           = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] pointer_model                  = ps2mouse {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] preallocate_images             = none {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] publish_errors                 = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] pybasedir                      = /opt/stack/nova {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ram_allocation_ratio           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] rate_limit_burst               = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] rate_limit_except_level        = CRITICAL {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] rate_limit_interval            = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] reboot_timeout                 = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] reclaim_instance_interval      = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] record                         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] reimage_timeout_per_gb         = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] report_interval                = 120 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] rescue_timeout                 = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] reserved_host_cpus             = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] reserved_host_disk_mb          = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] reserved_host_memory_mb        = 512 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] reserved_huge_pages            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] resize_confirm_window          = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] resize_fs_using_block_device   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] resume_guests_state_on_host_boot = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] rpc_response_timeout           = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] run_external_periodic_tasks    = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] running_deleted_instance_action = reap {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] running_deleted_instance_timeout = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] scheduler_instance_sync_interval = 120 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] service_down_time              = 720 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] servicegroup_driver            = db {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] shelved_offload_time           = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] shelved_poll_interval          = 3600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] shutdown_timeout               = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] source_is_ipv6                 = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ssl_only                       = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] state_path                     = /opt/stack/data/nova {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] sync_power_state_interval      = 600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] sync_power_state_pool_size     = 1000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] syslog_log_facility            = LOG_USER {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] tempdir                        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] timeout_nbd                    = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] transport_url                  = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] update_resources_interval      = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] use_cow_images                 = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] use_eventlog                   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] use_journal                    = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] use_json                       = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] use_rootwrap_daemon            = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] use_stderr                     = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] use_syslog                     = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vcpu_pin_set                   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vif_plugging_is_fatal          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vif_plugging_timeout           = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] virt_mkfs                      = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] volume_usage_poll_interval     = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] watch_log_file                 = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] web                            = /usr/share/spice-html5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_concurrency.disable_process_locking = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.auth_strategy              = keystone {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.compute_link_prefix        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.dhcp_domain                = novalocal {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.enable_instance_password   = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.glance_link_prefix         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.instance_list_per_project_cells = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.list_records_by_skipping_down_cells = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.local_metadata_per_cell    = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.max_limit                  = 1000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.metadata_cache_expiration  = 15 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.neutron_default_tenant_id  = default {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.use_forwarded_for          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.use_neutron_default_nets   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.vendordata_dynamic_targets = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.vendordata_jsonfile_path   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.backend_argument         = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.config_prefix            = cache.oslo {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.dead_timeout             = 60.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.debug_cache_backend      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.enable_retry_client      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.enable_socket_keepalive  = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.enabled                  = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.expiration_time          = 600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.hashclient_retry_attempts = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.memcache_dead_retry      = 300 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.memcache_password        =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.memcache_sasl_enabled    = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.memcache_username        =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.proxies                  = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.retry_attempts           = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.retry_delay              = 0.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.socket_keepalive_count   = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.socket_keepalive_idle    = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.socket_keepalive_interval = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.tls_allowed_ciphers      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.tls_cafile               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.tls_certfile             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.tls_enabled              = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cache.tls_keyfile              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.auth_section            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.auth_type               = password {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.cafile                  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.certfile                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.collect_timing          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.cross_az_attach         = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.debug                   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.endpoint_template       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.http_retries            = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.insecure                = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.keyfile                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.os_region_name          = RegionOne {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.split_loggers           = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cinder.timeout                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] compute.cpu_dedicated_set      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] compute.cpu_shared_set         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] compute.image_type_exclude_list = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] compute.resource_provider_association_refresh = 300 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] compute.shutdown_retry_interval = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] conductor.workers              = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] console.allowed_origins        = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] console.ssl_ciphers            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] console.ssl_minimum_version    = default {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] consoleauth.token_ttl          = 600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.cafile                  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.certfile                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.collect_timing          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.connect_retries         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.connect_retry_delay     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.endpoint_override       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.insecure                = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.keyfile                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.max_version             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.min_version             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.region_name             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.service_name            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.service_type            = accelerator {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.split_loggers           = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.status_code_retries     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.status_code_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.timeout                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] cyborg.version                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.backend               = sqlalchemy {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.connection            = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.connection_debug      = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.connection_parameters =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.connection_recycle_time = 3600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.connection_trace      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.db_inc_retry_interval = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.db_max_retries        = 20 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.db_max_retry_interval = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.db_retry_interval     = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.max_overflow          = 50 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.max_pool_size         = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.max_retries           = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.mysql_enable_ndb      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.mysql_wsrep_sync_wait = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.pool_timeout          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.retry_interval        = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.slave_connection      = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] database.sqlite_synchronous    = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.backend           = sqlalchemy {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.connection        = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.connection_debug  = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.connection_parameters =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.connection_recycle_time = 3600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.connection_trace  = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.db_inc_retry_interval = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.db_max_retries    = 20 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.db_max_retry_interval = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.db_retry_interval = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.max_overflow      = 50 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.max_pool_size     = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.max_retries       = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.mysql_enable_ndb  = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.pool_timeout      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.retry_interval    = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.slave_connection  = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] api_database.sqlite_synchronous = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] devices.enabled_mdev_types     = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ephemeral_storage_encryption.enabled = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.api_servers             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.cafile                  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.certfile                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.collect_timing          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.connect_retries         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.connect_retry_delay     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.debug                   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.default_trusted_certificate_ids = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.enable_certificate_validation = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.enable_rbd_download     = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.endpoint_override       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.insecure                = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.keyfile                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.max_version             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.min_version             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.num_retries             = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.rbd_ceph_conf           =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.rbd_connect_timeout     = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.rbd_pool                =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.rbd_user                =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.region_name             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.service_name            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.service_type            = image {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.split_loggers           = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.status_code_retries     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.status_code_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.timeout                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.verify_glance_signatures = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] glance.version                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] guestfs.debug                  = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.config_drive_cdrom      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.config_drive_inject_password = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.enable_remotefx         = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.instances_path_share    =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.limit_cpu_features      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.use_multipath_io        = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.vswitch_name            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] mks.enabled                    = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] image_cache.manager_interval   = 2400 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] image_cache.precache_concurrency = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] image_cache.remove_unused_base_images = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] image_cache.subdirectory_name  = _base {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.api_max_retries         = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.api_retry_interval      = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.auth_section            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.auth_type               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.cafile                  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.certfile                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.collect_timing          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.connect_retries         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.connect_retry_delay     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.endpoint_override       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.insecure                = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.keyfile                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.max_version             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.min_version             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.partition_key           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.peer_list               = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.region_name             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.serial_console_state_timeout = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.service_name            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.service_type            = baremetal {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.split_loggers           = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.status_code_retries     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.status_code_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.timeout                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ironic.version                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] key_manager.fixed_key          = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.barbican_api_version  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.barbican_endpoint     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.barbican_endpoint_type = public {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.barbican_region_name  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.cafile                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.certfile              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.collect_timing        = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.insecure              = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.keyfile               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.number_of_retries     = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.retry_delay           = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.send_service_user_token = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.split_loggers         = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.timeout               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.verify_ssl            = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican.verify_ssl_path       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican_service_user.auth_section = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican_service_user.auth_type = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican_service_user.cafile   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican_service_user.certfile = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican_service_user.collect_timing = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican_service_user.insecure = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican_service_user.keyfile  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican_service_user.split_loggers = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] barbican_service_user.timeout  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.approle_role_id          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.approle_secret_id        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.cafile                   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.certfile                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.collect_timing           = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.insecure                 = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.keyfile                  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.kv_mountpoint            = secret {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.kv_version               = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.namespace                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.root_token_id            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.split_loggers            = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.ssl_ca_crt_file          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.timeout                  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.use_ssl                  = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.cafile                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.certfile              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.collect_timing        = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.connect_retries       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.connect_retry_delay   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.endpoint_override     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.insecure              = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.keyfile               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.max_version           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.min_version           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.region_name           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.service_name          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.service_type          = identity {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.split_loggers         = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.status_code_retries   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.status_code_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.timeout               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] keystone.version               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.connection_uri         =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.cpu_mode               = custom {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: WARNING oslo_config.cfg [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.cpu_power_governor_high = performance {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.cpu_power_management   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.device_detach_attempts = 8 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.device_detach_timeout  = 20 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.disk_cachemodes        = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.disk_prefix            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.enabled_perf_events    = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.file_backed_memory     = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.gid_maps               = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.hw_disk_discard        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.hw_machine_type        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.images_rbd_pool        = rbd {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.images_type            = default {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.images_volume_group    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.inject_key             = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.inject_partition       = -2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.inject_password        = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.iscsi_iface            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.iser_use_multipath     = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.live_migration_downtime = 500 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.live_migration_inbound_addr = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.live_migration_scheme  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.live_migration_timeout_action = abort {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.live_migration_tunnelled = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: WARNING oslo_config.cfg [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 16 08:04:16 user nova-compute[73091]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 16 08:04:16 user nova-compute[73091]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 16 08:04:16 user nova-compute[73091]: and ``live_migration_inbound_addr`` respectively.
Aug 16 08:04:16 user nova-compute[73091]: ).  Its value may be silently ignored in the future.
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.live_migration_with_native_tls = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.max_queues             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.nfs_mount_options      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.num_pcie_ports         = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.pmem_namespaces        = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.quobyte_client_cfg     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.rbd_secret_uuid        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.rbd_user               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.rescue_image_id        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.rescue_kernel_id       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.rx_queue_size          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.smbfs_mount_options    =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.snapshot_compression   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.snapshot_image_format  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.sparse_logical_volumes = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.swtpm_enabled          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.swtpm_group            = tss {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.swtpm_user             = tss {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.sysinfo_serial         = unique {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.tb_cache_size          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.tx_queue_size          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.uid_maps               = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.use_virtio_for_bridges = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.virt_type              = kvm {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.volume_clear           = zero {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.volume_clear_size      = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.volume_use_multipath   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.vzstorage_cache_path   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.auth_section           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.auth_type              = password {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.cafile                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.certfile               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.collect_timing         = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.connect_retries        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.connect_retry_delay    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.default_floating_pool  = public {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.endpoint_override      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.extension_sync_interval = 600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.http_retries           = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.insecure               = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.keyfile                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.max_version            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.min_version            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.ovs_bridge             = br-int {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.physnets               = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.region_name            = RegionOne {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.service_metadata_proxy = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.service_name           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.service_type           = network {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.split_loggers          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.status_code_retries    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.status_code_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.timeout                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] neutron.version                = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] notifications.bdms_in_notifications = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] notifications.default_level    = INFO {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] notifications.notification_format = unversioned {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] notifications.notify_on_state_change = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] pci.alias                      = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] pci.device_spec                = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] pci.report_in_placement        = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.auth_section         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.auth_type            = password {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.cafile               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.certfile             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.collect_timing       = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.connect_retries      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.connect_retry_delay  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.default_domain_id    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.default_domain_name  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.domain_id            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.domain_name          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.endpoint_override    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.insecure             = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.keyfile              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.max_version          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.min_version          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.password             = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.project_domain_id    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.project_domain_name  = Default {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.project_id           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.project_name         = service {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.region_name          = RegionOne {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.service_name         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.service_type         = placement {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.split_loggers        = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.status_code_retries  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.status_code_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.system_scope         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.timeout              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.trust_id             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.user_domain_id       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.user_domain_name     = Default {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.user_id              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.username             = placement {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] placement.version              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] quota.cores                    = 20 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] quota.count_usage_from_placement = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] quota.injected_file_content_bytes = 10240 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] quota.injected_file_path_length = 255 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] quota.injected_files           = 5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] quota.instances                = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] quota.key_pairs                = 100 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] quota.metadata_items           = 128 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] quota.ram                      = 51200 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] quota.recheck_quota            = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] quota.server_group_members     = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] quota.server_groups            = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] rdp.enabled                    = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] scheduler.image_metadata_prefilter = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] scheduler.max_attempts         = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] scheduler.max_placement_results = 1000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] scheduler.workers              = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.host_subset_size = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.isolated_hosts = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.isolated_images = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.pci_in_placement = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.track_instance_changes = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] metrics.required               = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] metrics.weight_multiplier      = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] metrics.weight_setting         = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] serial_console.enabled         = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] serial_console.port_range      = 10000:20000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] serial_console.serialproxy_port = 6083 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] service_user.auth_section      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] service_user.auth_type         = password {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] service_user.cafile            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] service_user.certfile          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] service_user.collect_timing    = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] service_user.insecure          = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] service_user.keyfile           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] service_user.send_service_user_token = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] service_user.split_loggers     = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] service_user.timeout           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] spice.agent_enabled            = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] spice.enabled                  = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] spice.html5proxy_port          = 6082 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] spice.image_compression        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] spice.jpeg_compression         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] spice.playback_compression     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] spice.server_listen            = 127.0.0.1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] spice.streaming_mode           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] spice.zlib_compression         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] upgrade_levels.baseapi         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] upgrade_levels.cert            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] upgrade_levels.compute         = auto {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] upgrade_levels.conductor       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] upgrade_levels.scheduler       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vendordata_dynamic_auth.cafile = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vendordata_dynamic_auth.certfile = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vendordata_dynamic_auth.insecure = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vendordata_dynamic_auth.timeout = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.api_retry_count         = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.ca_file                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.cache_prefix            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.cluster_name            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.connection_pool_size    = 10 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.console_delay_seconds   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.datastore_regex         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.host_ip                 = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.host_password           = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.host_port               = 443 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.host_username           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.insecure                = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.integration_bridge      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.maximum_objects         = 100 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.pbm_default_policy      = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.pbm_enabled             = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.pbm_wsdl_location       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.serial_port_proxy_uri   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.serial_port_service_uri = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.task_poll_interval      = 0.5 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.use_linked_clone        = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.vnc_keymap              = en-us {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.vnc_port                = 5900 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vmware.vnc_port_total          = 10000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vnc.auth_schemes               = ['none'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vnc.enabled                    = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vnc.novncproxy_port            = 6080 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vnc.vencrypt_ca_certs          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vnc.vencrypt_client_cert       = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vnc.vencrypt_client_key        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.disable_rootwrap   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.enable_numa_live_migration = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.libvirt_disable_apic = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] wsgi.client_socket_timeout     = 900 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] wsgi.default_pool_size         = 1000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] wsgi.keep_alive                = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] wsgi.max_header_line           = 16384 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] wsgi.ssl_ca_file               = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] wsgi.ssl_cert_file             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] wsgi.ssl_key_file              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] wsgi.tcp_keepidle              = 600 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] zvm.ca_file                    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] zvm.cloud_connector_url        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] zvm.reachable_timeout          = 300 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_policy.enforce_new_defaults = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_policy.enforce_scope      = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_policy.policy_default_rule = default {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] profiler.connection_string     = messaging:// {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] profiler.enabled               = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] profiler.es_doc_type           = notification {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] profiler.es_scroll_size        = 10000 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] profiler.es_scroll_time        = 2m {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] profiler.filter_error_trace    = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] profiler.hmac_keys             = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] profiler.sentinel_service_name = mymaster {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] profiler.socket_timeout        = 0.1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] profiler.trace_requests        = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] profiler.trace_sqlalchemy      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] profiler_jaeger.process_tags   = {} {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] profiler_jaeger.service_name_prefix = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] profiler_otlp.service_name_prefix = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] remote_debug.host              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] remote_debug.port              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_notifications.retry = -1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.auth_section        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.auth_type           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.cafile              = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.certfile            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.collect_timing      = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.connect_retries     = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.connect_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.endpoint_id         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.endpoint_override   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.insecure            = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.keyfile             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.max_version         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.min_version         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.region_name         = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.service_name        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.service_type        = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.split_loggers       = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.status_code_retries = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.status_code_retry_delay = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.timeout             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.valid_interfaces    = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_limit.version             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_reports.file_event_handler = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] oslo_reports.log_dir           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vif_plug_ovs_privileged.group  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] vif_plug_ovs_privileged.user   = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_vif_ovs.isolate_vif         = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] os_brick.lock_path             = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] privsep_osbrick.capabilities   = [21] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] privsep_osbrick.group          = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] privsep_osbrick.helper_command = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] privsep_osbrick.user           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] nova_sys_admin.group           = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] nova_sys_admin.helper_command  = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] nova_sys_admin.user            = None {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG oslo_service.service [None req-194e0738-10c4-443d-8757-3416aa90d095 None None] ******************************************************************************** {{(pid=73091) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 16 08:04:16 user nova-compute[73091]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 16 08:04:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Starting native event thread {{(pid=73091) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Starting green dispatch thread {{(pid=73091) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Starting connection event dispatch thread {{(pid=73091) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 16 08:04:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Connecting to libvirt: qemu:///system {{(pid=73091) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 16 08:04:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fb8f9644ee0> {{(pid=73091) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 16 08:04:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fb8f9644ee0> {{(pid=73091) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 16 08:04:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Connection event '1' reason 'None'
Aug 16 08:04:17 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 08:04:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.mount [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Initialising _HostMountState generation 0 {{(pid=73091) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 16 08:04:23 user nova-compute[73091]: INFO nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Libvirt host capabilities <capabilities>
Aug 16 08:04:23 user nova-compute[73091]:   <host>
Aug 16 08:04:23 user nova-compute[73091]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 16 08:04:23 user nova-compute[73091]:     <cpu>
Aug 16 08:04:23 user nova-compute[73091]:       <arch>x86_64</arch>
Aug 16 08:04:23 user nova-compute[73091]:       <model>IvyBridge-IBRS</model>
Aug 16 08:04:23 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 08:04:23 user nova-compute[73091]:       <microcode version='1070'/>
Aug 16 08:04:23 user nova-compute[73091]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 16 08:04:23 user nova-compute[73091]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 16 08:04:23 user nova-compute[73091]:       <feature name='ss'/>
Aug 16 08:04:23 user nova-compute[73091]:       <feature name='vmx'/>
Aug 16 08:04:23 user nova-compute[73091]:       <feature name='pcid'/>
Aug 16 08:04:23 user nova-compute[73091]:       <feature name='osxsave'/>
Aug 16 08:04:23 user nova-compute[73091]:       <feature name='hypervisor'/>
Aug 16 08:04:23 user nova-compute[73091]:       <feature name='arat'/>
Aug 16 08:04:23 user nova-compute[73091]:       <feature name='tsc_adjust'/>
Aug 16 08:04:23 user nova-compute[73091]:       <feature name='md-clear'/>
Aug 16 08:04:23 user nova-compute[73091]:       <feature name='stibp'/>
Aug 16 08:04:23 user nova-compute[73091]:       <feature name='arch-capabilities'/>
Aug 16 08:04:23 user nova-compute[73091]:       <feature name='ssbd'/>
Aug 16 08:04:23 user nova-compute[73091]:       <feature name='invtsc'/>
Aug 16 08:04:23 user nova-compute[73091]:       <feature name='rsba'/>
Aug 16 08:04:23 user nova-compute[73091]:       <feature name='skip-l1dfl-vmentry'/>
Aug 16 08:04:23 user nova-compute[73091]:       <pages unit='KiB' size='4'/>
Aug 16 08:04:23 user nova-compute[73091]:       <pages unit='KiB' size='2048'/>
Aug 16 08:04:23 user nova-compute[73091]:     </cpu>
Aug 16 08:04:23 user nova-compute[73091]:     <power_management>
Aug 16 08:04:23 user nova-compute[73091]:       <suspend_mem/>
Aug 16 08:04:23 user nova-compute[73091]:       <suspend_disk/>
Aug 16 08:04:23 user nova-compute[73091]:       <suspend_hybrid/>
Aug 16 08:04:23 user nova-compute[73091]:     </power_management>
Aug 16 08:04:23 user nova-compute[73091]:     <iommu support='no'/>
Aug 16 08:04:23 user nova-compute[73091]:     <migration_features>
Aug 16 08:04:23 user nova-compute[73091]:       <live/>
Aug 16 08:04:23 user nova-compute[73091]:       <uri_transports>
Aug 16 08:04:23 user nova-compute[73091]:         <uri_transport>tcp</uri_transport>
Aug 16 08:04:23 user nova-compute[73091]:         <uri_transport>rdma</uri_transport>
Aug 16 08:04:23 user nova-compute[73091]:       </uri_transports>
Aug 16 08:04:23 user nova-compute[73091]:     </migration_features>
Aug 16 08:04:23 user nova-compute[73091]:     <topology>
Aug 16 08:04:23 user nova-compute[73091]:       <cells num='2'>
Aug 16 08:04:23 user nova-compute[73091]:         <cell id='0'>
Aug 16 08:04:23 user nova-compute[73091]:           <memory unit='KiB'>8189224</memory>
Aug 16 08:04:23 user nova-compute[73091]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 16 08:04:23 user nova-compute[73091]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 08:04:23 user nova-compute[73091]:           <distances>
Aug 16 08:04:23 user nova-compute[73091]:             <sibling id='0' value='10'/>
Aug 16 08:04:23 user nova-compute[73091]:             <sibling id='1' value='20'/>
Aug 16 08:04:23 user nova-compute[73091]:           </distances>
Aug 16 08:04:23 user nova-compute[73091]:           <cpus num='6'>
Aug 16 08:04:23 user nova-compute[73091]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 16 08:04:23 user nova-compute[73091]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 16 08:04:23 user nova-compute[73091]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 16 08:04:23 user nova-compute[73091]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 16 08:04:24 user nova-compute[73091]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 16 08:04:24 user nova-compute[73091]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 16 08:04:24 user nova-compute[73091]:           </cpus>
Aug 16 08:04:24 user nova-compute[73091]:         </cell>
Aug 16 08:04:24 user nova-compute[73091]:         <cell id='1'>
Aug 16 08:04:24 user nova-compute[73091]:           <memory unit='KiB'>8206460</memory>
Aug 16 08:04:24 user nova-compute[73091]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 16 08:04:24 user nova-compute[73091]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 08:04:24 user nova-compute[73091]:           <distances>
Aug 16 08:04:24 user nova-compute[73091]:             <sibling id='0' value='20'/>
Aug 16 08:04:24 user nova-compute[73091]:             <sibling id='1' value='10'/>
Aug 16 08:04:24 user nova-compute[73091]:           </distances>
Aug 16 08:04:24 user nova-compute[73091]:           <cpus num='6'>
Aug 16 08:04:24 user nova-compute[73091]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 16 08:04:24 user nova-compute[73091]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 16 08:04:24 user nova-compute[73091]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 16 08:04:24 user nova-compute[73091]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 16 08:04:24 user nova-compute[73091]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 16 08:04:24 user nova-compute[73091]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 16 08:04:24 user nova-compute[73091]:           </cpus>
Aug 16 08:04:24 user nova-compute[73091]:         </cell>
Aug 16 08:04:24 user nova-compute[73091]:       </cells>
Aug 16 08:04:24 user nova-compute[73091]:     </topology>
Aug 16 08:04:24 user nova-compute[73091]:     <cache>
Aug 16 08:04:24 user nova-compute[73091]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 16 08:04:24 user nova-compute[73091]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 16 08:04:24 user nova-compute[73091]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 16 08:04:24 user nova-compute[73091]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 16 08:04:24 user nova-compute[73091]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 16 08:04:24 user nova-compute[73091]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 16 08:04:24 user nova-compute[73091]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 16 08:04:24 user nova-compute[73091]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 16 08:04:24 user nova-compute[73091]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 16 08:04:24 user nova-compute[73091]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 16 08:04:24 user nova-compute[73091]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 16 08:04:24 user nova-compute[73091]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 16 08:04:24 user nova-compute[73091]:     </cache>
Aug 16 08:04:24 user nova-compute[73091]:     <secmodel>
Aug 16 08:04:24 user nova-compute[73091]:       <model>apparmor</model>
Aug 16 08:04:24 user nova-compute[73091]:       <doi>0</doi>
Aug 16 08:04:24 user nova-compute[73091]:     </secmodel>
Aug 16 08:04:24 user nova-compute[73091]:     <secmodel>
Aug 16 08:04:24 user nova-compute[73091]:       <model>dac</model>
Aug 16 08:04:24 user nova-compute[73091]:       <doi>0</doi>
Aug 16 08:04:24 user nova-compute[73091]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 16 08:04:24 user nova-compute[73091]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 16 08:04:24 user nova-compute[73091]:     </secmodel>
Aug 16 08:04:24 user nova-compute[73091]:   </host>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='alpha'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>clipper</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='armv6l'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>spitz</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>nuri</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>kzm</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sx1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>z2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>tosa</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>n810</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>n800</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>terrier</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>midway</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>microbit</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>verdex</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>highbank</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>akita</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>connex</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>collie</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='armv7l'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>spitz</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>nuri</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>kzm</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sx1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>z2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>tosa</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>n810</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>n800</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>terrier</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>midway</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>microbit</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>verdex</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>highbank</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>akita</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>connex</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>collie</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='aarch64'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>spitz</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>nuri</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>kzm</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sx1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>z2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>tosa</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>n810</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>n800</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>terrier</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>midway</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>microbit</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>verdex</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>raspi3b</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>highbank</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>akita</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>connex</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>collie</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <acpi default='on' toggle='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='cris'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='i686'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>isapc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>microvm</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='kvm'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <pae/>
Aug 16 08:04:24 user nova-compute[73091]:       <nonpae/>
Aug 16 08:04:24 user nova-compute[73091]:       <acpi default='on' toggle='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:       <apic default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='m68k'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>an5206</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>q800</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>next-cube</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='microblaze'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='microblazeel'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='mips'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='16'>malta</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='mipsel'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='16'>malta</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='mips64'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='16'>malta</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>pica61</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>magnum</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='mips64el'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='16'>malta</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>pica61</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>magnum</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='16'>boston</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='ppc'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mac99</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>40p</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>taihu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='ppc64'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>taihu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>40p</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mac99</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='ppc64le'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>taihu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>40p</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>mac99</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='riscv32'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='8'>spike</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>opentitan</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='8'>virt</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='riscv64'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='8'>spike</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>shakti_c</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='8'>virt</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='s390x'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='sh4'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>shix</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>r2d</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='sh4eb'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>shix</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>r2d</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='sparc'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>SS-5</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>SS-20</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>LX</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>SS-4</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>SS-10</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>Voyager</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='sparc64'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sun4u</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>niagara</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>sun4v</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='x86_64'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>64</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='1'>isapc</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>microvm</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='kvm'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <acpi default='on' toggle='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:       <apic default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='xtensa'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>sim</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>kc705</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>ml605</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>virt</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>lx200</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>lx60</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]:   <guest>
Aug 16 08:04:24 user nova-compute[73091]:     <os_type>hvm</os_type>
Aug 16 08:04:24 user nova-compute[73091]:     <arch name='xtensaeb'>
Aug 16 08:04:24 user nova-compute[73091]:       <wordsize>32</wordsize>
Aug 16 08:04:24 user nova-compute[73091]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='4'>sim</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>kc705</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>ml605</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>virt</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>lx200</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>lx60</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 08:04:24 user nova-compute[73091]:       <domain type='qemu'/>
Aug 16 08:04:24 user nova-compute[73091]:     </arch>
Aug 16 08:04:24 user nova-compute[73091]:     <features>
Aug 16 08:04:24 user nova-compute[73091]:       <cpuselection/>
Aug 16 08:04:24 user nova-compute[73091]:       <deviceboot/>
Aug 16 08:04:24 user nova-compute[73091]:       <disksnapshot default='on' toggle='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     </features>
Aug 16 08:04:24 user nova-compute[73091]:   </guest>
Aug 16 08:04:24 user nova-compute[73091]: </capabilities>
Aug 16 08:04:24 user nova-compute[73091]: 
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 16 08:04:24 user nova-compute[73091]: <domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 08:04:24 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 08:04:24 user nova-compute[73091]:   <machine>pc-i440fx-jammy</machine>
Aug 16 08:04:24 user nova-compute[73091]:   <arch>i686</arch>
Aug 16 08:04:24 user nova-compute[73091]:   <vcpu max='255'/>
Aug 16 08:04:24 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:   <os supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='firmware'/>
Aug 16 08:04:24 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>rom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pflash</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>yes</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='secure'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </loader>
Aug 16 08:04:24 user nova-compute[73091]:   </os>
Aug 16 08:04:24 user nova-compute[73091]:   <cpu>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>on</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='lm'/>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>kvm64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>core2duo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Westmere</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Penryn</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G1</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Nehalem</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Conroe</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:   </cpu>
Aug 16 08:04:24 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>file</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>memfd</value>
Aug 16 08:04:24 user nova-compute[73091]:     </enum>
Aug 16 08:04:24 user nova-compute[73091]:   </memoryBacking>
Aug 16 08:04:24 user nova-compute[73091]:   <devices>
Aug 16 08:04:24 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>disk</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>floppy</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>lun</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='bus'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>ide</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>fdc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sata</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </disk>
Aug 16 08:04:24 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sdl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vnc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>spice</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </graphics>
Aug 16 08:04:24 user nova-compute[73091]:     <video supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>qxl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>none</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>bochs</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </video>
Aug 16 08:04:24 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='mode'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>default</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>requisite</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>optional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pci</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 08:04:24 user nova-compute[73091]:     </hostdev>
Aug 16 08:04:24 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>random</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egd</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>builtin</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </rng>
Aug 16 08:04:24 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>path</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>handle</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </filesystem>
Aug 16 08:04:24 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>emulator</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </tpm>
Aug 16 08:04:24 user nova-compute[73091]:   </devices>
Aug 16 08:04:24 user nova-compute[73091]:   <features>
Aug 16 08:04:24 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:   </features>
Aug 16 08:04:24 user nova-compute[73091]: </domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 16 08:04:24 user nova-compute[73091]: <domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 08:04:24 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 08:04:24 user nova-compute[73091]:   <machine>pc-q35-jammy</machine>
Aug 16 08:04:24 user nova-compute[73091]:   <arch>i686</arch>
Aug 16 08:04:24 user nova-compute[73091]:   <vcpu max='288'/>
Aug 16 08:04:24 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:   <os supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='firmware'/>
Aug 16 08:04:24 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>rom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pflash</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>yes</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='secure'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </loader>
Aug 16 08:04:24 user nova-compute[73091]:   </os>
Aug 16 08:04:24 user nova-compute[73091]:   <cpu>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>on</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='lm'/>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>kvm64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>core2duo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Westmere</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Penryn</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G1</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Nehalem</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Conroe</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:   </cpu>
Aug 16 08:04:24 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>file</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>memfd</value>
Aug 16 08:04:24 user nova-compute[73091]:     </enum>
Aug 16 08:04:24 user nova-compute[73091]:   </memoryBacking>
Aug 16 08:04:24 user nova-compute[73091]:   <devices>
Aug 16 08:04:24 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>disk</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>floppy</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>lun</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='bus'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>fdc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sata</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </disk>
Aug 16 08:04:24 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sdl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vnc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>spice</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </graphics>
Aug 16 08:04:24 user nova-compute[73091]:     <video supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>qxl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>none</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>bochs</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </video>
Aug 16 08:04:24 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='mode'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>default</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>requisite</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>optional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pci</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 08:04:24 user nova-compute[73091]:     </hostdev>
Aug 16 08:04:24 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>random</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egd</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>builtin</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </rng>
Aug 16 08:04:24 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>path</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>handle</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </filesystem>
Aug 16 08:04:24 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>emulator</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </tpm>
Aug 16 08:04:24 user nova-compute[73091]:   </devices>
Aug 16 08:04:24 user nova-compute[73091]:   <features>
Aug 16 08:04:24 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:   </features>
Aug 16 08:04:24 user nova-compute[73091]: </domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 16 08:04:24 user nova-compute[73091]: <domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 08:04:24 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 08:04:24 user nova-compute[73091]:   <machine>pc-q35-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:   <arch>i686</arch>
Aug 16 08:04:24 user nova-compute[73091]:   <vcpu max='288'/>
Aug 16 08:04:24 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:   <os supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='firmware'/>
Aug 16 08:04:24 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>rom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pflash</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>yes</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='secure'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </loader>
Aug 16 08:04:24 user nova-compute[73091]:   </os>
Aug 16 08:04:24 user nova-compute[73091]:   <cpu>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>on</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='lm'/>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>kvm64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>core2duo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Westmere</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Penryn</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G1</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Nehalem</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Conroe</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:   </cpu>
Aug 16 08:04:24 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>file</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>memfd</value>
Aug 16 08:04:24 user nova-compute[73091]:     </enum>
Aug 16 08:04:24 user nova-compute[73091]:   </memoryBacking>
Aug 16 08:04:24 user nova-compute[73091]:   <devices>
Aug 16 08:04:24 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>disk</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>floppy</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>lun</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='bus'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>fdc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sata</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </disk>
Aug 16 08:04:24 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sdl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vnc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>spice</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </graphics>
Aug 16 08:04:24 user nova-compute[73091]:     <video supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>qxl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>none</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>bochs</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </video>
Aug 16 08:04:24 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='mode'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>default</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>requisite</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>optional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pci</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 08:04:24 user nova-compute[73091]:     </hostdev>
Aug 16 08:04:24 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>random</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egd</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>builtin</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </rng>
Aug 16 08:04:24 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>path</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>handle</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </filesystem>
Aug 16 08:04:24 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>emulator</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </tpm>
Aug 16 08:04:24 user nova-compute[73091]:   </devices>
Aug 16 08:04:24 user nova-compute[73091]:   <features>
Aug 16 08:04:24 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:   </features>
Aug 16 08:04:24 user nova-compute[73091]: </domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 16 08:04:24 user nova-compute[73091]: <domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 08:04:24 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 08:04:24 user nova-compute[73091]:   <machine>pc-i440fx-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:   <arch>i686</arch>
Aug 16 08:04:24 user nova-compute[73091]:   <vcpu max='255'/>
Aug 16 08:04:24 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:   <os supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='firmware'/>
Aug 16 08:04:24 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>rom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pflash</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>yes</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='secure'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </loader>
Aug 16 08:04:24 user nova-compute[73091]:   </os>
Aug 16 08:04:24 user nova-compute[73091]:   <cpu>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>on</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='lm'/>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>kvm64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>core2duo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Westmere</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Penryn</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G1</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Nehalem</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Conroe</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:   </cpu>
Aug 16 08:04:24 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>file</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>memfd</value>
Aug 16 08:04:24 user nova-compute[73091]:     </enum>
Aug 16 08:04:24 user nova-compute[73091]:   </memoryBacking>
Aug 16 08:04:24 user nova-compute[73091]:   <devices>
Aug 16 08:04:24 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>disk</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>floppy</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>lun</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='bus'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>ide</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>fdc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sata</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </disk>
Aug 16 08:04:24 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sdl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vnc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>spice</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </graphics>
Aug 16 08:04:24 user nova-compute[73091]:     <video supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>qxl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>none</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>bochs</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </video>
Aug 16 08:04:24 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='mode'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>default</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>requisite</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>optional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pci</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 08:04:24 user nova-compute[73091]:     </hostdev>
Aug 16 08:04:24 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>random</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egd</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>builtin</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </rng>
Aug 16 08:04:24 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>path</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>handle</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </filesystem>
Aug 16 08:04:24 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>emulator</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </tpm>
Aug 16 08:04:24 user nova-compute[73091]:   </devices>
Aug 16 08:04:24 user nova-compute[73091]:   <features>
Aug 16 08:04:24 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:   </features>
Aug 16 08:04:24 user nova-compute[73091]: </domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 16 08:04:24 user nova-compute[73091]: <domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 08:04:24 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 08:04:24 user nova-compute[73091]:   <machine>pc-i440fx-jammy</machine>
Aug 16 08:04:24 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 16 08:04:24 user nova-compute[73091]:   <vcpu max='255'/>
Aug 16 08:04:24 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:   <os supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='firmware'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>efi</value>
Aug 16 08:04:24 user nova-compute[73091]:     </enum>
Aug 16 08:04:24 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>rom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pflash</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>yes</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='secure'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </loader>
Aug 16 08:04:24 user nova-compute[73091]:   </os>
Aug 16 08:04:24 user nova-compute[73091]:   <cpu>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>on</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>on</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='invtsc'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='rsba'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>kvm64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>core2duo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Westmere</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Penryn</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Opteron_G1</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Nehalem</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Conroe</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:   </cpu>
Aug 16 08:04:24 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>file</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>memfd</value>
Aug 16 08:04:24 user nova-compute[73091]:     </enum>
Aug 16 08:04:24 user nova-compute[73091]:   </memoryBacking>
Aug 16 08:04:24 user nova-compute[73091]:   <devices>
Aug 16 08:04:24 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>disk</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>floppy</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>lun</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='bus'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>ide</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>fdc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sata</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </disk>
Aug 16 08:04:24 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sdl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vnc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>spice</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </graphics>
Aug 16 08:04:24 user nova-compute[73091]:     <video supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>qxl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>none</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>bochs</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </video>
Aug 16 08:04:24 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='mode'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>default</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>requisite</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>optional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pci</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 08:04:24 user nova-compute[73091]:     </hostdev>
Aug 16 08:04:24 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>random</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egd</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>builtin</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </rng>
Aug 16 08:04:24 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>path</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>handle</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </filesystem>
Aug 16 08:04:24 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>emulator</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </tpm>
Aug 16 08:04:24 user nova-compute[73091]:   </devices>
Aug 16 08:04:24 user nova-compute[73091]:   <features>
Aug 16 08:04:24 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:   </features>
Aug 16 08:04:24 user nova-compute[73091]: </domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 16 08:04:24 user nova-compute[73091]: <domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 08:04:24 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 08:04:24 user nova-compute[73091]:   <machine>pc-q35-jammy</machine>
Aug 16 08:04:24 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 16 08:04:24 user nova-compute[73091]:   <vcpu max='288'/>
Aug 16 08:04:24 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:   <os supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='firmware'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>efi</value>
Aug 16 08:04:24 user nova-compute[73091]:     </enum>
Aug 16 08:04:24 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>rom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pflash</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>yes</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='secure'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>yes</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </loader>
Aug 16 08:04:24 user nova-compute[73091]:   </os>
Aug 16 08:04:24 user nova-compute[73091]:   <cpu>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>on</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>on</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='invtsc'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='rsba'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>kvm64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>core2duo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Westmere</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Penryn</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Opteron_G1</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Nehalem</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Conroe</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:   </cpu>
Aug 16 08:04:24 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>file</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>memfd</value>
Aug 16 08:04:24 user nova-compute[73091]:     </enum>
Aug 16 08:04:24 user nova-compute[73091]:   </memoryBacking>
Aug 16 08:04:24 user nova-compute[73091]:   <devices>
Aug 16 08:04:24 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>disk</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>floppy</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>lun</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='bus'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>fdc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sata</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </disk>
Aug 16 08:04:24 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sdl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vnc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>spice</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </graphics>
Aug 16 08:04:24 user nova-compute[73091]:     <video supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>qxl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>none</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>bochs</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </video>
Aug 16 08:04:24 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='mode'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>default</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>requisite</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>optional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pci</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 08:04:24 user nova-compute[73091]:     </hostdev>
Aug 16 08:04:24 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>random</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egd</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>builtin</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </rng>
Aug 16 08:04:24 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>path</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>handle</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </filesystem>
Aug 16 08:04:24 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>emulator</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </tpm>
Aug 16 08:04:24 user nova-compute[73091]:   </devices>
Aug 16 08:04:24 user nova-compute[73091]:   <features>
Aug 16 08:04:24 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:   </features>
Aug 16 08:04:24 user nova-compute[73091]: </domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 16 08:04:24 user nova-compute[73091]: <domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 08:04:24 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 08:04:24 user nova-compute[73091]:   <machine>pc-q35-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 16 08:04:24 user nova-compute[73091]:   <vcpu max='288'/>
Aug 16 08:04:24 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:   <os supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='firmware'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>efi</value>
Aug 16 08:04:24 user nova-compute[73091]:     </enum>
Aug 16 08:04:24 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>rom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pflash</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>yes</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='secure'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>yes</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </loader>
Aug 16 08:04:24 user nova-compute[73091]:   </os>
Aug 16 08:04:24 user nova-compute[73091]:   <cpu>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>on</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>on</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='invtsc'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='rsba'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>kvm64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>core2duo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Westmere</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Penryn</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Opteron_G1</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Nehalem</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Conroe</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:   </cpu>
Aug 16 08:04:24 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>file</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>memfd</value>
Aug 16 08:04:24 user nova-compute[73091]:     </enum>
Aug 16 08:04:24 user nova-compute[73091]:   </memoryBacking>
Aug 16 08:04:24 user nova-compute[73091]:   <devices>
Aug 16 08:04:24 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>disk</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>floppy</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>lun</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='bus'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>fdc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sata</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </disk>
Aug 16 08:04:24 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sdl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vnc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>spice</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </graphics>
Aug 16 08:04:24 user nova-compute[73091]:     <video supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>qxl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>none</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>bochs</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </video>
Aug 16 08:04:24 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='mode'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>default</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>requisite</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>optional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pci</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 08:04:24 user nova-compute[73091]:     </hostdev>
Aug 16 08:04:24 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>random</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egd</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>builtin</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </rng>
Aug 16 08:04:24 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>path</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>handle</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </filesystem>
Aug 16 08:04:24 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>emulator</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </tpm>
Aug 16 08:04:24 user nova-compute[73091]:   </devices>
Aug 16 08:04:24 user nova-compute[73091]:   <features>
Aug 16 08:04:24 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:   </features>
Aug 16 08:04:24 user nova-compute[73091]: </domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 16 08:04:24 user nova-compute[73091]: <domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 08:04:24 user nova-compute[73091]:   <domain>kvm</domain>
Aug 16 08:04:24 user nova-compute[73091]:   <machine>pc-i440fx-6.2</machine>
Aug 16 08:04:24 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 16 08:04:24 user nova-compute[73091]:   <vcpu max='255'/>
Aug 16 08:04:24 user nova-compute[73091]:   <iothreads supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:   <os supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='firmware'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>efi</value>
Aug 16 08:04:24 user nova-compute[73091]:     </enum>
Aug 16 08:04:24 user nova-compute[73091]:     <loader supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>rom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pflash</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='readonly'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>yes</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='secure'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>no</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </loader>
Aug 16 08:04:24 user nova-compute[73091]:   </os>
Aug 16 08:04:24 user nova-compute[73091]:   <cpu>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-passthrough' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='hostPassthroughMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>on</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='maximum' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='maximumMigratable'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>on</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>off</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='host-model' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <vendor>Intel</vendor>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ss'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='vmx'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='pcid'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='hypervisor'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arat'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='umip'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='md-clear'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='invtsc'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibpb'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='ibrs'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-stibp'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='rsba'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='erms'/>
Aug 16 08:04:24 user nova-compute[73091]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:     <mode name='custom' supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>qemu64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>qemu32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>phenom</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>pentium</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>n270</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>kvm64</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>kvm32</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>coreduo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>core2duo</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>athlon</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Westmere</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Snowridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Skylake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>SandyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Penryn</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G5</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G4</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G3</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Opteron_G2</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Opteron_G1</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Nehalem</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>IvyBridge</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Icelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Haswell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Rome</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-Milan</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>EPYC</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Dhyana</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cooperlake</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>Conroe</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='no'>Broadwell</model>
Aug 16 08:04:24 user nova-compute[73091]:       <model usable='yes'>486</model>
Aug 16 08:04:24 user nova-compute[73091]:     </mode>
Aug 16 08:04:24 user nova-compute[73091]:   </cpu>
Aug 16 08:04:24 user nova-compute[73091]:   <memoryBacking supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:     <enum name='sourceType'>
Aug 16 08:04:24 user nova-compute[73091]:       <value>file</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>anonymous</value>
Aug 16 08:04:24 user nova-compute[73091]:       <value>memfd</value>
Aug 16 08:04:24 user nova-compute[73091]:     </enum>
Aug 16 08:04:24 user nova-compute[73091]:   </memoryBacking>
Aug 16 08:04:24 user nova-compute[73091]:   <devices>
Aug 16 08:04:24 user nova-compute[73091]:     <disk supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='diskDevice'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>disk</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cdrom</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>floppy</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>lun</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='bus'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>ide</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>fdc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sata</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </disk>
Aug 16 08:04:24 user nova-compute[73091]:     <graphics supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='type'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>sdl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vnc</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>spice</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egl-headless</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </graphics>
Aug 16 08:04:24 user nova-compute[73091]:     <video supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='modelType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>cirrus</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>vmvga</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>qxl</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>none</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>bochs</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>ramfb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </video>
Aug 16 08:04:24 user nova-compute[73091]:     <hostdev supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='mode'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>subsystem</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='startupPolicy'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>default</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>mandatory</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>requisite</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>optional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='subsysType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>usb</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>pci</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>scsi</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='capsType'/>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='pciBackend'/>
Aug 16 08:04:24 user nova-compute[73091]:     </hostdev>
Aug 16 08:04:24 user nova-compute[73091]:     <rng supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtio-non-transitional</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>random</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>egd</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>builtin</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </rng>
Aug 16 08:04:24 user nova-compute[73091]:     <filesystem supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='driverType'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>path</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>handle</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>virtiofs</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </filesystem>
Aug 16 08:04:24 user nova-compute[73091]:     <tpm supported='yes'>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='model'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-tis</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>tpm-crb</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:       <enum name='backendModel'>
Aug 16 08:04:24 user nova-compute[73091]:         <value>passthrough</value>
Aug 16 08:04:24 user nova-compute[73091]:         <value>emulator</value>
Aug 16 08:04:24 user nova-compute[73091]:       </enum>
Aug 16 08:04:24 user nova-compute[73091]:     </tpm>
Aug 16 08:04:24 user nova-compute[73091]:   </devices>
Aug 16 08:04:24 user nova-compute[73091]:   <features>
Aug 16 08:04:24 user nova-compute[73091]:     <gic supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:     <vmcoreinfo supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <genid supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backingStoreInput supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <backup supported='yes'/>
Aug 16 08:04:24 user nova-compute[73091]:     <sev supported='no'/>
Aug 16 08:04:24 user nova-compute[73091]:   </features>
Aug 16 08:04:24 user nova-compute[73091]: </domainCapabilities>
Aug 16 08:04:24 user nova-compute[73091]:  {{(pid=73091) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73091) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73091) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Checking secure boot support for host arch (x86_64) {{(pid=73091) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Checking secure boot support for host arch (x86_64) {{(pid=73091) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Checking secure boot support for host arch (x86_64) {{(pid=73091) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 08:04:24 user nova-compute[73091]: INFO nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Secure Boot support detected
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] cpu compare xml: <cpu match="exact">
Aug 16 08:04:24 user nova-compute[73091]:   <model>Nehalem</model>
Aug 16 08:04:24 user nova-compute[73091]: </cpu>
Aug 16 08:04:24 user nova-compute[73091]:  {{(pid=73091) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 16 08:04:24 user nova-compute[73091]: INFO nova.virt.node [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Generated node identity a5935d1e-4613-4ec5-92d3-58605923e4b9
Aug 16 08:04:24 user nova-compute[73091]: INFO nova.virt.node [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Wrote node identity a5935d1e-4613-4ec5-92d3-58605923e4b9 to /opt/stack/data/nova/compute_id
Aug 16 08:04:24 user nova-compute[73091]: WARNING nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Compute nodes ['a5935d1e-4613-4ec5-92d3-58605923e4b9'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 16 08:04:24 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 16 08:04:24 user nova-compute[73091]: WARNING nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 08:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:04:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:04:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Hypervisor/Node resource view: name=user free_ram=10857MB free_disk=26.235923767089844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:04:24 user nova-compute[73091]: WARNING nova.compute.resource_tracker [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] No compute node record for user:a5935d1e-4613-4ec5-92d3-58605923e4b9: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host a5935d1e-4613-4ec5-92d3-58605923e4b9 could not be found.
Aug 16 08:04:24 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Compute node record created for user:user with uuid: a5935d1e-4613-4ec5-92d3-58605923e4b9
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:04:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:04:24 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [req-c7cce9f9-6634-47c1-ab7d-6df7089071c7] Created resource provider record via placement API for resource provider with UUID a5935d1e-4613-4ec5-92d3-58605923e4b9 and name user.
Aug 16 08:04:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73091) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 16 08:04:25 user nova-compute[73091]: INFO nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] kernel doesn't support AMD SEV
Aug 16 08:04:25 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Updating inventory in ProviderTree for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 08:04:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:04:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Libvirt baseline CPU <cpu>
Aug 16 08:04:25 user nova-compute[73091]:   <arch>x86_64</arch>
Aug 16 08:04:25 user nova-compute[73091]:   <model>Nehalem</model>
Aug 16 08:04:25 user nova-compute[73091]:   <vendor>Intel</vendor>
Aug 16 08:04:25 user nova-compute[73091]:   <topology sockets="6" cores="1" threads="1"/>
Aug 16 08:04:25 user nova-compute[73091]: </cpu>
Aug 16 08:04:25 user nova-compute[73091]:  {{(pid=73091) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 16 08:04:25 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Updated inventory for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 16 08:04:25 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Updating resource provider a5935d1e-4613-4ec5-92d3-58605923e4b9 generation from 0 to 1 during operation: update_inventory {{(pid=73091) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 08:04:25 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Updating inventory in ProviderTree for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 08:04:25 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Updating resource provider a5935d1e-4613-4ec5-92d3-58605923e4b9 generation from 1 to 2 during operation: update_traits {{(pid=73091) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 08:04:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:04:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.714s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:04:25 user nova-compute[73091]: DEBUG nova.service [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Creating RPC server for service compute {{(pid=73091) start /opt/stack/nova/nova/service.py:182}}
Aug 16 08:04:25 user nova-compute[73091]: DEBUG nova.service [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Join ServiceGroup membership for this service compute {{(pid=73091) start /opt/stack/nova/nova/service.py:199}}
Aug 16 08:04:25 user nova-compute[73091]: DEBUG nova.servicegroup.drivers.db [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73091) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 16 08:04:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:04:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:05:16 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:05:16 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:05:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=10270MB free_disk=26.139564514160156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:05:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:06:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:06:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:06:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:06:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:06:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:06:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:06:16 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:06:17 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:06:17 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:06:17 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=10190MB free_disk=26.186092376708984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:06:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:06:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:06:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:07:17 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:07:17 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:07:17 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=10187MB free_disk=25.969913482666016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:07:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:07:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:07:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:07:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 08:07:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 08:07:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:07:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:07:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:07:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:07:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:07:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:08:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:08:17 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:08:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:08:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:08:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:08:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:08:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:08:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=9475MB free_disk=25.99288558959961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:08:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:08:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:08:18 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:08:18 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:08:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:08:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:08:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:08:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 08:08:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 08:08:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:08:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:08:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:08:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:08:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:08:20 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:08:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:08:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:25 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:08:25 user nova-compute[73091]: INFO nova.compute.claims [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Claim successful on node user
Aug 16 08:08:25 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:08:25 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:08:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:08:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:08:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:08:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:08:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:08:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:08:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:08:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Creating image(s)
Aug 16 08:08:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "/opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "/opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa.part --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa.part --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG nova.virt.images [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] 9c570403-184d-4d84-97e0-b6d49d2e29e7 was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa.part /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa.converted {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:08:27 user nova-compute[73091]: INFO nova.compute.claims [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Claim successful on node user
Aug 16 08:08:27 user nova-compute[73091]: DEBUG nova.policy [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a24330919014a2985e7926747cbbcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417ed7a5d52f4f7eaa4b6328864808ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa.part /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa.converted" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa.converted --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.344s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:27 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmlr97_c_/privsep.sock']
Aug 16 08:08:27 user sudo[82366]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmlr97_c_/privsep.sock
Aug 16 08:08:27 user sudo[82366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 08:08:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:08:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:08:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:08:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Creating image(s)
Aug 16 08:08:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "/opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "/opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:27 user nova-compute[73091]: DEBUG nova.policy [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a24330919014a2985e7926747cbbcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417ed7a5d52f4f7eaa4b6328864808ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:08:29 user sudo[82366]: pam_unix(sudo:session): session closed for user root
Aug 16 08:08:29 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Spawned new privsep daemon via rootwrap
Aug 16 08:08:29 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 08:08:29 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 08:08:29 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 16 08:08:29 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82370
Aug 16 08:08:29 user nova-compute[73091]: WARNING oslo_privsep.priv_context [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] privsep daemon already running
Aug 16 08:08:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.210s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk 1073741824" returned: 0 in 0.299s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.485s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.470s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.265s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk 1073741824" returned: 0 in 0.066s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Successfully created port: 92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Cannot resize image /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'migration_context' on Instance uuid bd541280-cecf-4c1c-bd1f-f7edff830f1e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Ensure instance console log exists: /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:08:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Successfully created port: e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Cannot resize image /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'migration_context' on Instance uuid 4a6248b9-f577-4efd-baa2-eb5eb3e47495 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Ensure instance console log exists: /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "cc7973d9-c703-4345-bf58-ccbe80fd07ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "cc7973d9-c703-4345-bf58-ccbe80fd07ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:08:31 user nova-compute[73091]: INFO nova.compute.claims [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Claim successful on node user
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.network.neutron [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:08:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:08:31 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Creating image(s)
Aug 16 08:08:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "/opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "/opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG nova.policy [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '196d845c007043b3aead43d76d94df07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85ea39234954b05a5a5b21cc52b30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk 1073741824" returned: 0 in 0.094s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Cannot resize image /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lazy-loading 'migration_context' on Instance uuid cc7973d9-c703-4345-bf58-ccbe80fd07ac {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Ensure instance console log exists: /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:33 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Successfully updated port: 92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquired lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-94f966ce-13a1-48be-b8c2-f58a52904fb0 req-fabebbc5-7591-4faa-8fb8-2dfc1fbf9905 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received event network-changed-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-94f966ce-13a1-48be-b8c2-f58a52904fb0 req-fabebbc5-7591-4faa-8fb8-2dfc1fbf9905 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Refreshing instance network info cache due to event network-changed-92dd6fb6-f2a1-4af9-be67-6fd7770517e4. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-94f966ce-13a1-48be-b8c2-f58a52904fb0 req-fabebbc5-7591-4faa-8fb8-2dfc1fbf9905 service nova] Acquiring lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Successfully updated port: e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquired lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-ddc39453-239c-475b-abce-a9a8f50d8ba7 req-d0f2ec78-42b3-45da-bd0f-15d98eb7d668 service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Received event network-changed-e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-ddc39453-239c-475b-abce-a9a8f50d8ba7 req-d0f2ec78-42b3-45da-bd0f-15d98eb7d668 service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Refreshing instance network info cache due to event network-changed-e00351b1-2886-496b-9a27-606de620f78d. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:08:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ddc39453-239c-475b-abce-a9a8f50d8ba7 req-d0f2ec78-42b3-45da-bd0f-15d98eb7d668 service nova] Acquiring lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Successfully created port: 75463757-0a11-47fa-8270-d756556eb589 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Updating instance_info_cache with network_info: [{"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Releasing lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Instance network_info: |[{"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-94f966ce-13a1-48be-b8c2-f58a52904fb0 req-fabebbc5-7591-4faa-8fb8-2dfc1fbf9905 service nova] Acquired lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-94f966ce-13a1-48be-b8c2-f58a52904fb0 req-fabebbc5-7591-4faa-8fb8-2dfc1fbf9905 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Refreshing network info cache for port 92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Start _get_guest_xml network_info=[{"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:08:35 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:08:35 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1967828394',display_name='tempest-ServerRescueNegativeTestJSON-server-1967828394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1967828394',id=1,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='417ed7a5d52f4f7eaa4b6328864808ea',ramdisk_id='',reservation_id='r-vqktvm90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1374385894',owner_user_name='tempest-ServerRescueNegativeTestJSON-1374385894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:08:26Z,user_data=None,user_id='7a24330919014a2985e7926747cbbcdc',uuid=bd541280-cecf-4c1c-bd1f-f7edff830f1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converting VIF {"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=92dd6fb6-f2a1-4af9-be67-6fd7770517e4,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92dd6fb6-f2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'pci_devices' on Instance uuid bd541280-cecf-4c1c-bd1f-f7edff830f1e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:08:35 user nova-compute[73091]:   <uuid>bd541280-cecf-4c1c-bd1f-f7edff830f1e</uuid>
Aug 16 08:08:35 user nova-compute[73091]:   <name>instance-00000001</name>
Aug 16 08:08:35 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:08:35 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:08:35 user nova-compute[73091]:   <metadata>
Aug 16 08:08:35 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:08:35 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:08:35 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1967828394</nova:name>
Aug 16 08:08:35 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:08:35</nova:creationTime>
Aug 16 08:08:35 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:08:35 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:08:35 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:08:35 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:08:35 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:08:35 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:08:35 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:08:35 user nova-compute[73091]:       <nova:owner>
Aug 16 08:08:35 user nova-compute[73091]:         <nova:user uuid="7a24330919014a2985e7926747cbbcdc">tempest-ServerRescueNegativeTestJSON-1374385894-project-member</nova:user>
Aug 16 08:08:35 user nova-compute[73091]:         <nova:project uuid="417ed7a5d52f4f7eaa4b6328864808ea">tempest-ServerRescueNegativeTestJSON-1374385894</nova:project>
Aug 16 08:08:35 user nova-compute[73091]:       </nova:owner>
Aug 16 08:08:35 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:08:35 user nova-compute[73091]:       <nova:ports>
Aug 16 08:08:35 user nova-compute[73091]:         <nova:port uuid="92dd6fb6-f2a1-4af9-be67-6fd7770517e4">
Aug 16 08:08:35 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 08:08:35 user nova-compute[73091]:         </nova:port>
Aug 16 08:08:35 user nova-compute[73091]:       </nova:ports>
Aug 16 08:08:35 user nova-compute[73091]:     </nova:instance>
Aug 16 08:08:35 user nova-compute[73091]:   </metadata>
Aug 16 08:08:35 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:08:35 user nova-compute[73091]:     <system>
Aug 16 08:08:35 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:08:35 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:08:35 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:08:35 user nova-compute[73091]:       <entry name="serial">bd541280-cecf-4c1c-bd1f-f7edff830f1e</entry>
Aug 16 08:08:35 user nova-compute[73091]:       <entry name="uuid">bd541280-cecf-4c1c-bd1f-f7edff830f1e</entry>
Aug 16 08:08:35 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:08:35 user nova-compute[73091]:     </system>
Aug 16 08:08:35 user nova-compute[73091]:   </sysinfo>
Aug 16 08:08:35 user nova-compute[73091]:   <os>
Aug 16 08:08:35 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:08:35 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:08:35 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:08:35 user nova-compute[73091]:   </os>
Aug 16 08:08:35 user nova-compute[73091]:   <features>
Aug 16 08:08:35 user nova-compute[73091]:     <acpi/>
Aug 16 08:08:35 user nova-compute[73091]:     <apic/>
Aug 16 08:08:35 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:08:35 user nova-compute[73091]:   </features>
Aug 16 08:08:35 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:08:35 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:08:35 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:08:35 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:08:35 user nova-compute[73091]:   </clock>
Aug 16 08:08:35 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:08:35 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:08:35 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:08:35 user nova-compute[73091]:   </cpu>
Aug 16 08:08:35 user nova-compute[73091]:   <devices>
Aug 16 08:08:35 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:08:35 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:08:35 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk"/>
Aug 16 08:08:35 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:08:35 user nova-compute[73091]:     </disk>
Aug 16 08:08:35 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:08:35 user nova-compute[73091]:       <mac address="fa:16:3e:60:a4:3f"/>
Aug 16 08:08:35 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:08:35 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:08:35 user nova-compute[73091]:       <target dev="tap92dd6fb6-f2"/>
Aug 16 08:08:35 user nova-compute[73091]:     </interface>
Aug 16 08:08:35 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:08:35 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/console.log" append="off"/>
Aug 16 08:08:35 user nova-compute[73091]:     </serial>
Aug 16 08:08:35 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:08:35 user nova-compute[73091]:     <video>
Aug 16 08:08:35 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:08:35 user nova-compute[73091]:     </video>
Aug 16 08:08:35 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:08:35 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:08:35 user nova-compute[73091]:     </rng>
Aug 16 08:08:35 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:08:35 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:08:35 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:08:35 user nova-compute[73091]:     </memballoon>
Aug 16 08:08:35 user nova-compute[73091]:   </devices>
Aug 16 08:08:35 user nova-compute[73091]: </domain>
Aug 16 08:08:35 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1967828394',display_name='tempest-ServerRescueNegativeTestJSON-server-1967828394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1967828394',id=1,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='417ed7a5d52f4f7eaa4b6328864808ea',ramdisk_id='',reservation_id='r-vqktvm90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1374385894',owner_user_name='tempest-ServerRescueNegativeTestJSON-1374385894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:08:26Z,user_data=None,user_id='7a24330919014a2985e7926747cbbcdc',uuid=bd541280-cecf-4c1c-bd1f-f7edff830f1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converting VIF {"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=92dd6fb6-f2a1-4af9-be67-6fd7770517e4,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92dd6fb6-f2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG os_vif [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=92dd6fb6-f2a1-4af9-be67-6fd7770517e4,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92dd6fb6-f2') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Created schema index Interface.name {{(pid=73091) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Created schema index Port.name {{(pid=73091) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Created schema index Bridge.name {{(pid=73091) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [POLLOUT] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:08:35 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp9ozscb6v/privsep.sock']
Aug 16 08:08:35 user sudo[82468]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp9ozscb6v/privsep.sock
Aug 16 08:08:35 user sudo[82468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 08:08:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "daf2b789-eba2-419b-99f6-be8f483151ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "daf2b789-eba2-419b-99f6-be8f483151ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-94f966ce-13a1-48be-b8c2-f58a52904fb0 req-fabebbc5-7591-4faa-8fb8-2dfc1fbf9905 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Updated VIF entry in instance network info cache for port 92dd6fb6-f2a1-4af9-be67-6fd7770517e4. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-94f966ce-13a1-48be-b8c2-f58a52904fb0 req-fabebbc5-7591-4faa-8fb8-2dfc1fbf9905 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Updating instance_info_cache with network_info: [{"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-94f966ce-13a1-48be-b8c2-f58a52904fb0 req-fabebbc5-7591-4faa-8fb8-2dfc1fbf9905 service nova] Releasing lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:08:36 user nova-compute[73091]: INFO nova.compute.claims [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Claim successful on node user
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Updating instance_info_cache with network_info: [{"id": "e00351b1-2886-496b-9a27-606de620f78d", "address": "fa:16:3e:13:43:df", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00351b1-28", "ovs_interfaceid": "e00351b1-2886-496b-9a27-606de620f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Releasing lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Instance network_info: |[{"id": "e00351b1-2886-496b-9a27-606de620f78d", "address": "fa:16:3e:13:43:df", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00351b1-28", "ovs_interfaceid": "e00351b1-2886-496b-9a27-606de620f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ddc39453-239c-475b-abce-a9a8f50d8ba7 req-d0f2ec78-42b3-45da-bd0f-15d98eb7d668 service nova] Acquired lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-ddc39453-239c-475b-abce-a9a8f50d8ba7 req-d0f2ec78-42b3-45da-bd0f-15d98eb7d668 service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Refreshing network info cache for port e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Start _get_guest_xml network_info=[{"id": "e00351b1-2886-496b-9a27-606de620f78d", "address": "fa:16:3e:13:43:df", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00351b1-28", "ovs_interfaceid": "e00351b1-2886-496b-9a27-606de620f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:08:36 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:08:36 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1432471970',display_name='tempest-ServerRescueNegativeTestJSON-server-1432471970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1432471970',id=2,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='417ed7a5d52f4f7eaa4b6328864808ea',ramdisk_id='',reservation_id='r-4o0tk1mr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1374385894',owner_user_name='tempest-ServerRescueNegativeTestJSON-1374385894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:08:28Z,user_data=None,user_id='7a24330919014a2985e7926747cbbcdc',uuid=4a6248b9-f577-4efd-baa2-eb5eb3e47495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e00351b1-2886-496b-9a27-606de620f78d", "address": "fa:16:3e:13:43:df", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00351b1-28", "ovs_interfaceid": "e00351b1-2886-496b-9a27-606de620f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converting VIF {"id": "e00351b1-2886-496b-9a27-606de620f78d", "address": "fa:16:3e:13:43:df", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00351b1-28", "ovs_interfaceid": "e00351b1-2886-496b-9a27-606de620f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:43:df,bridge_name='br-int',has_traffic_filtering=True,id=e00351b1-2886-496b-9a27-606de620f78d,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape00351b1-28') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a6248b9-f577-4efd-baa2-eb5eb3e47495 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:08:36 user nova-compute[73091]:   <uuid>4a6248b9-f577-4efd-baa2-eb5eb3e47495</uuid>
Aug 16 08:08:36 user nova-compute[73091]:   <name>instance-00000002</name>
Aug 16 08:08:36 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:08:36 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:08:36 user nova-compute[73091]:   <metadata>
Aug 16 08:08:36 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:08:36 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:08:36 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1432471970</nova:name>
Aug 16 08:08:36 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:08:36</nova:creationTime>
Aug 16 08:08:36 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:08:36 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:08:36 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:08:36 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:08:36 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:08:36 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:08:36 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:08:36 user nova-compute[73091]:       <nova:owner>
Aug 16 08:08:36 user nova-compute[73091]:         <nova:user uuid="7a24330919014a2985e7926747cbbcdc">tempest-ServerRescueNegativeTestJSON-1374385894-project-member</nova:user>
Aug 16 08:08:36 user nova-compute[73091]:         <nova:project uuid="417ed7a5d52f4f7eaa4b6328864808ea">tempest-ServerRescueNegativeTestJSON-1374385894</nova:project>
Aug 16 08:08:36 user nova-compute[73091]:       </nova:owner>
Aug 16 08:08:36 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:08:36 user nova-compute[73091]:       <nova:ports>
Aug 16 08:08:36 user nova-compute[73091]:         <nova:port uuid="e00351b1-2886-496b-9a27-606de620f78d">
Aug 16 08:08:36 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 08:08:36 user nova-compute[73091]:         </nova:port>
Aug 16 08:08:36 user nova-compute[73091]:       </nova:ports>
Aug 16 08:08:36 user nova-compute[73091]:     </nova:instance>
Aug 16 08:08:36 user nova-compute[73091]:   </metadata>
Aug 16 08:08:36 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:08:36 user nova-compute[73091]:     <system>
Aug 16 08:08:36 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:08:36 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:08:36 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:08:36 user nova-compute[73091]:       <entry name="serial">4a6248b9-f577-4efd-baa2-eb5eb3e47495</entry>
Aug 16 08:08:36 user nova-compute[73091]:       <entry name="uuid">4a6248b9-f577-4efd-baa2-eb5eb3e47495</entry>
Aug 16 08:08:36 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:08:36 user nova-compute[73091]:     </system>
Aug 16 08:08:36 user nova-compute[73091]:   </sysinfo>
Aug 16 08:08:36 user nova-compute[73091]:   <os>
Aug 16 08:08:36 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:08:36 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:08:36 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:08:36 user nova-compute[73091]:   </os>
Aug 16 08:08:36 user nova-compute[73091]:   <features>
Aug 16 08:08:36 user nova-compute[73091]:     <acpi/>
Aug 16 08:08:36 user nova-compute[73091]:     <apic/>
Aug 16 08:08:36 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:08:36 user nova-compute[73091]:   </features>
Aug 16 08:08:36 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:08:36 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:08:36 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:08:36 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:08:36 user nova-compute[73091]:   </clock>
Aug 16 08:08:36 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:08:36 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:08:36 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:08:36 user nova-compute[73091]:   </cpu>
Aug 16 08:08:36 user nova-compute[73091]:   <devices>
Aug 16 08:08:36 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:08:36 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:08:36 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk"/>
Aug 16 08:08:36 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:08:36 user nova-compute[73091]:     </disk>
Aug 16 08:08:36 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:08:36 user nova-compute[73091]:       <mac address="fa:16:3e:13:43:df"/>
Aug 16 08:08:36 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:08:36 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:08:36 user nova-compute[73091]:       <target dev="tape00351b1-28"/>
Aug 16 08:08:36 user nova-compute[73091]:     </interface>
Aug 16 08:08:36 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:08:36 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/console.log" append="off"/>
Aug 16 08:08:36 user nova-compute[73091]:     </serial>
Aug 16 08:08:36 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:08:36 user nova-compute[73091]:     <video>
Aug 16 08:08:36 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:08:36 user nova-compute[73091]:     </video>
Aug 16 08:08:36 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:08:36 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:08:36 user nova-compute[73091]:     </rng>
Aug 16 08:08:36 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:08:36 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:08:36 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:08:36 user nova-compute[73091]:     </memballoon>
Aug 16 08:08:36 user nova-compute[73091]:   </devices>
Aug 16 08:08:36 user nova-compute[73091]: </domain>
Aug 16 08:08:36 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1432471970',display_name='tempest-ServerRescueNegativeTestJSON-server-1432471970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1432471970',id=2,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='417ed7a5d52f4f7eaa4b6328864808ea',ramdisk_id='',reservation_id='r-4o0tk1mr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1374385894',owner_user_name='tempest-ServerRescueNegativeTestJSON-1374385894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:08:28Z,user_data=None,user_id='7a24330919014a2985e7926747cbbcdc',uuid=4a6248b9-f577-4efd-baa2-eb5eb3e47495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e00351b1-2886-496b-9a27-606de620f78d", "address": "fa:16:3e:13:43:df", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00351b1-28", "ovs_interfaceid": "e00351b1-2886-496b-9a27-606de620f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converting VIF {"id": "e00351b1-2886-496b-9a27-606de620f78d", "address": "fa:16:3e:13:43:df", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00351b1-28", "ovs_interfaceid": "e00351b1-2886-496b-9a27-606de620f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:43:df,bridge_name='br-int',has_traffic_filtering=True,id=e00351b1-2886-496b-9a27-606de620f78d,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape00351b1-28') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG os_vif [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:43:df,bridge_name='br-int',has_traffic_filtering=True,id=e00351b1-2886-496b-9a27-606de620f78d,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape00351b1-28') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:08:36 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.policy [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5a61e00249d4bc4b14dd0ab5b88e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc3a302cc78494296980753b56edb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:08:36 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Creating image(s)
Aug 16 08:08:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "/opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "/opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "/opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk 1073741824" returned: 0 in 0.045s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:37 user sudo[82468]: pam_unix(sudo:session): session closed for user root
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:37 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Spawned new privsep daemon via rootwrap
Aug 16 08:08:37 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 08:08:37 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 08:08:37 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 16 08:08:37 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82483
Aug 16 08:08:37 user nova-compute[73091]: WARNING oslo_privsep.priv_context [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] privsep daemon already running
Aug 16 08:08:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Successfully created port: a8445f80-1201-4794-b715-36e357399997 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.251s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Checking if we can resize image /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Cannot resize image /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lazy-loading 'migration_context' on Instance uuid daf2b789-eba2-419b-99f6-be8f483151ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Ensure instance console log exists: /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "476de8ea-30dd-4b52-be37-f134e445757f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92dd6fb6-f2, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap92dd6fb6-f2, col_values=(('external_ids', {'iface-id': '92dd6fb6-f2a1-4af9-be67-6fd7770517e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:a4:3f', 'vm-uuid': 'bd541280-cecf-4c1c-bd1f-f7edff830f1e'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:38 user nova-compute[73091]: INFO os_vif [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=92dd6fb6-f2a1-4af9-be67-6fd7770517e4,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92dd6fb6-f2')
Aug 16 08:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape00351b1-28, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape00351b1-28, col_values=(('external_ids', {'iface-id': 'e00351b1-2886-496b-9a27-606de620f78d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:43:df', 'vm-uuid': '4a6248b9-f577-4efd-baa2-eb5eb3e47495'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:38 user nova-compute[73091]: INFO os_vif [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:43:df,bridge_name='br-int',has_traffic_filtering=True,id=e00351b1-2886-496b-9a27-606de620f78d,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape00351b1-28')
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No VIF found with MAC fa:16:3e:60:a4:3f, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:08:38 user nova-compute[73091]: INFO nova.compute.claims [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Claim successful on node user
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No VIF found with MAC fa:16:3e:13:43:df, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-ddc39453-239c-475b-abce-a9a8f50d8ba7 req-d0f2ec78-42b3-45da-bd0f-15d98eb7d668 service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Updated VIF entry in instance network info cache for port e00351b1-2886-496b-9a27-606de620f78d. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-ddc39453-239c-475b-abce-a9a8f50d8ba7 req-d0f2ec78-42b3-45da-bd0f-15d98eb7d668 service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Updating instance_info_cache with network_info: [{"id": "e00351b1-2886-496b-9a27-606de620f78d", "address": "fa:16:3e:13:43:df", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00351b1-28", "ovs_interfaceid": "e00351b1-2886-496b-9a27-606de620f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ddc39453-239c-475b-abce-a9a8f50d8ba7 req-d0f2ec78-42b3-45da-bd0f-15d98eb7d668 service nova] Releasing lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:08:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:08:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Creating image(s)
Aug 16 08:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "/opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "/opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "/opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Successfully updated port: a8445f80-1201-4794-b715-36e357399997 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-2328f934-8bed-420c-8fcc-ad2527f7162d req-1453f448-fbbf-405a-908f-c552d8165dd1 service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Received event network-changed-a8445f80-1201-4794-b715-36e357399997 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-2328f934-8bed-420c-8fcc-ad2527f7162d req-1453f448-fbbf-405a-908f-c552d8165dd1 service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Refreshing instance network info cache due to event network-changed-a8445f80-1201-4794-b715-36e357399997. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2328f934-8bed-420c-8fcc-ad2527f7162d req-1453f448-fbbf-405a-908f-c552d8165dd1 service nova] Acquiring lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2328f934-8bed-420c-8fcc-ad2527f7162d req-1453f448-fbbf-405a-908f-c552d8165dd1 service nova] Acquired lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-2328f934-8bed-420c-8fcc-ad2527f7162d req-1453f448-fbbf-405a-908f-c552d8165dd1 service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Refreshing network info cache for port a8445f80-1201-4794-b715-36e357399997 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.policy [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c18882b1744742dbb0b5d157aed696a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0498ad9dc84c56ad076bae8fd158a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-2328f934-8bed-420c-8fcc-ad2527f7162d req-1453f448-fbbf-405a-908f-c552d8165dd1 service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk 1073741824" returned: 0 in 0.042s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Successfully updated port: 75463757-0a11-47fa-8270-d756556eb589 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Checking if we can resize image /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "refresh_cache-cc7973d9-c703-4345-bf58-ccbe80fd07ac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquired lock "refresh_cache-cc7973d9-c703-4345-bf58-ccbe80fd07ac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-2328f934-8bed-420c-8fcc-ad2527f7162d req-1453f448-fbbf-405a-908f-c552d8165dd1 service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2328f934-8bed-420c-8fcc-ad2527f7162d req-1453f448-fbbf-405a-908f-c552d8165dd1 service nova] Releasing lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquired lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Cannot resize image /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lazy-loading 'migration_context' on Instance uuid 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Ensure instance console log exists: /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-472df019-b524-44d7-bca8-05cd987eddfd req-9289ed2f-da0c-4aa8-b439-042ba3efac6b service nova] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Received event network-changed-75463757-0a11-47fa-8270-d756556eb589 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-472df019-b524-44d7-bca8-05cd987eddfd req-9289ed2f-da0c-4aa8-b439-042ba3efac6b service nova] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Refreshing instance network info cache due to event network-changed-75463757-0a11-47fa-8270-d756556eb589. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:08:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-472df019-b524-44d7-bca8-05cd987eddfd req-9289ed2f-da0c-4aa8-b439-042ba3efac6b service nova] Acquiring lock "refresh_cache-cc7973d9-c703-4345-bf58-ccbe80fd07ac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Updating instance_info_cache with network_info: [{"id": "75463757-0a11-47fa-8270-d756556eb589", "address": "fa:16:3e:c3:27:58", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75463757-0a", "ovs_interfaceid": "75463757-0a11-47fa-8270-d756556eb589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Releasing lock "refresh_cache-cc7973d9-c703-4345-bf58-ccbe80fd07ac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Instance network_info: |[{"id": "75463757-0a11-47fa-8270-d756556eb589", "address": "fa:16:3e:c3:27:58", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75463757-0a", "ovs_interfaceid": "75463757-0a11-47fa-8270-d756556eb589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-472df019-b524-44d7-bca8-05cd987eddfd req-9289ed2f-da0c-4aa8-b439-042ba3efac6b service nova] Acquired lock "refresh_cache-cc7973d9-c703-4345-bf58-ccbe80fd07ac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.network.neutron [req-472df019-b524-44d7-bca8-05cd987eddfd req-9289ed2f-da0c-4aa8-b439-042ba3efac6b service nova] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Refreshing network info cache for port 75463757-0a11-47fa-8270-d756556eb589 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Start _get_guest_xml network_info=[{"id": "75463757-0a11-47fa-8270-d756556eb589", "address": "fa:16:3e:c3:27:58", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75463757-0a", "ovs_interfaceid": "75463757-0a11-47fa-8270-d756556eb589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Updating instance_info_cache with network_info: [{"id": "a8445f80-1201-4794-b715-36e357399997", "address": "fa:16:3e:d2:ee:e5", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8445f80-12", "ovs_interfaceid": "a8445f80-1201-4794-b715-36e357399997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:08:40 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:08:40 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:08:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Releasing lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Instance network_info: |[{"id": "a8445f80-1201-4794-b715-36e357399997", "address": "fa:16:3e:d2:ee:e5", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8445f80-12", "ovs_interfaceid": "a8445f80-1201-4794-b715-36e357399997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Start _get_guest_xml network_info=[{"id": "a8445f80-1201-4794-b715-36e357399997", "address": "fa:16:3e:d2:ee:e5", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8445f80-12", "ovs_interfaceid": "a8445f80-1201-4794-b715-36e357399997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1780848775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1780848775',id=3,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c85ea39234954b05a5a5b21cc52b30ec',ramdisk_id='',reservation_id='r-27oeda06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1623646564',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:08:32Z,user_data=None,user_id='196d845c007043b3aead43d76d94df07',uuid=cc7973d9-c703-4345-bf58-ccbe80fd07ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75463757-0a11-47fa-8270-d756556eb589", "address": "fa:16:3e:c3:27:58", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75463757-0a", "ovs_interfaceid": "75463757-0a11-47fa-8270-d756556eb589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Converting VIF {"id": "75463757-0a11-47fa-8270-d756556eb589", "address": "fa:16:3e:c3:27:58", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75463757-0a", "ovs_interfaceid": "75463757-0a11-47fa-8270-d756556eb589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:58,bridge_name='br-int',has_traffic_filtering=True,id=75463757-0a11-47fa-8270-d756556eb589,network=Network(231d0163-8e3c-408f-bc7d-92a34ba1fde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75463757-0a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lazy-loading 'pci_devices' on Instance uuid cc7973d9-c703-4345-bf58-ccbe80fd07ac {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:40 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:08:40 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:08:40 user nova-compute[73091]:   <uuid>cc7973d9-c703-4345-bf58-ccbe80fd07ac</uuid>
Aug 16 08:08:40 user nova-compute[73091]:   <name>instance-00000003</name>
Aug 16 08:08:40 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:08:40 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:08:40 user nova-compute[73091]:   <metadata>
Aug 16 08:08:40 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:08:40 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:08:40 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1780848775</nova:name>
Aug 16 08:08:40 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:08:40</nova:creationTime>
Aug 16 08:08:40 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:08:40 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:08:40 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:08:40 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:08:40 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:08:40 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:08:40 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:08:40 user nova-compute[73091]:       <nova:owner>
Aug 16 08:08:40 user nova-compute[73091]:         <nova:user uuid="196d845c007043b3aead43d76d94df07">tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member</nova:user>
Aug 16 08:08:40 user nova-compute[73091]:         <nova:project uuid="c85ea39234954b05a5a5b21cc52b30ec">tempest-ServerBootFromVolumeStableRescueTest-1623646564</nova:project>
Aug 16 08:08:40 user nova-compute[73091]:       </nova:owner>
Aug 16 08:08:40 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:08:40 user nova-compute[73091]:       <nova:ports>
Aug 16 08:08:40 user nova-compute[73091]:         <nova:port uuid="75463757-0a11-47fa-8270-d756556eb589">
Aug 16 08:08:40 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 08:08:40 user nova-compute[73091]:         </nova:port>
Aug 16 08:08:40 user nova-compute[73091]:       </nova:ports>
Aug 16 08:08:40 user nova-compute[73091]:     </nova:instance>
Aug 16 08:08:40 user nova-compute[73091]:   </metadata>
Aug 16 08:08:40 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:08:40 user nova-compute[73091]:     <system>
Aug 16 08:08:40 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:08:40 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:08:40 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:08:40 user nova-compute[73091]:       <entry name="serial">cc7973d9-c703-4345-bf58-ccbe80fd07ac</entry>
Aug 16 08:08:40 user nova-compute[73091]:       <entry name="uuid">cc7973d9-c703-4345-bf58-ccbe80fd07ac</entry>
Aug 16 08:08:40 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:08:40 user nova-compute[73091]:     </system>
Aug 16 08:08:40 user nova-compute[73091]:   </sysinfo>
Aug 16 08:08:40 user nova-compute[73091]:   <os>
Aug 16 08:08:40 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:08:40 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:08:40 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:08:40 user nova-compute[73091]:   </os>
Aug 16 08:08:40 user nova-compute[73091]:   <features>
Aug 16 08:08:40 user nova-compute[73091]:     <acpi/>
Aug 16 08:08:40 user nova-compute[73091]:     <apic/>
Aug 16 08:08:40 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:08:40 user nova-compute[73091]:   </features>
Aug 16 08:08:40 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:08:40 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:08:40 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:08:40 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:08:40 user nova-compute[73091]:   </clock>
Aug 16 08:08:40 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:08:40 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:08:40 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:08:40 user nova-compute[73091]:   </cpu>
Aug 16 08:08:40 user nova-compute[73091]:   <devices>
Aug 16 08:08:40 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:08:40 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:08:40 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk"/>
Aug 16 08:08:40 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:08:40 user nova-compute[73091]:     </disk>
Aug 16 08:08:40 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:08:40 user nova-compute[73091]:       <mac address="fa:16:3e:c3:27:58"/>
Aug 16 08:08:40 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:08:40 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:08:40 user nova-compute[73091]:       <target dev="tap75463757-0a"/>
Aug 16 08:08:40 user nova-compute[73091]:     </interface>
Aug 16 08:08:40 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:08:40 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/console.log" append="off"/>
Aug 16 08:08:40 user nova-compute[73091]:     </serial>
Aug 16 08:08:40 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:08:40 user nova-compute[73091]:     <video>
Aug 16 08:08:40 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:08:40 user nova-compute[73091]:     </video>
Aug 16 08:08:40 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:08:40 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:08:40 user nova-compute[73091]:     </rng>
Aug 16 08:08:40 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:08:40 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:08:40 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:08:40 user nova-compute[73091]:     </memballoon>
Aug 16 08:08:40 user nova-compute[73091]:   </devices>
Aug 16 08:08:40 user nova-compute[73091]: </domain>
Aug 16 08:08:40 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1780848775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1780848775',id=3,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c85ea39234954b05a5a5b21cc52b30ec',ramdisk_id='',reservation_id='r-27oeda06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1623646564',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:08:32Z,user_data=None,user_id='196d845c007043b3aead43d76d94df07',uuid=cc7973d9-c703-4345-bf58-ccbe80fd07ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75463757-0a11-47fa-8270-d756556eb589", "address": "fa:16:3e:c3:27:58", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75463757-0a", "ovs_interfaceid": "75463757-0a11-47fa-8270-d756556eb589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Converting VIF {"id": "75463757-0a11-47fa-8270-d756556eb589", "address": "fa:16:3e:c3:27:58", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75463757-0a", "ovs_interfaceid": "75463757-0a11-47fa-8270-d756556eb589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:58,bridge_name='br-int',has_traffic_filtering=True,id=75463757-0a11-47fa-8270-d756556eb589,network=Network(231d0163-8e3c-408f-bc7d-92a34ba1fde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75463757-0a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG os_vif [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:58,bridge_name='br-int',has_traffic_filtering=True,id=75463757-0a11-47fa-8270-d756556eb589,network=Network(231d0163-8e3c-408f-bc7d-92a34ba1fde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75463757-0a') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75463757-0a, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75463757-0a, col_values=(('external_ids', {'iface-id': '75463757-0a11-47fa-8270-d756556eb589', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:27:58', 'vm-uuid': 'cc7973d9-c703-4345-bf58-ccbe80fd07ac'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:40 user nova-compute[73091]: INFO os_vif [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:58,bridge_name='br-int',has_traffic_filtering=True,id=75463757-0a11-47fa-8270-d756556eb589,network=Network(231d0163-8e3c-408f-bc7d-92a34ba1fde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75463757-0a')
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-424441131',display_name='tempest-ServerActionsTestOtherA-server-424441131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-424441131',id=4,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINoJzCi5cbqDbv92eFfW9aMRXJ4/2v0OQ2hSDLpAu4w1/ZPKBMXJyWSrEcsjVc2ims7W5PLPKHUxP3vEgoDrV6EsVr9zR047a1gU5GWukvuMwQeS2cKyebWkm1qMWtR6Q==',key_name='tempest-keypair-1466249258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fc3a302cc78494296980753b56edb0c',ramdisk_id='',reservation_id='r-zq24o2tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-534432070',owner_user_name='tempest-ServerActionsTestOtherA-534432070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5a61e00249d4bc4b14dd0ab5b88e58c',uuid=daf2b789-eba2-419b-99f6-be8f483151ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8445f80-1201-4794-b715-36e357399997", "address": "fa:16:3e:d2:ee:e5", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8445f80-12", "ovs_interfaceid": "a8445f80-1201-4794-b715-36e357399997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converting VIF {"id": "a8445f80-1201-4794-b715-36e357399997", "address": "fa:16:3e:d2:ee:e5", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8445f80-12", "ovs_interfaceid": "a8445f80-1201-4794-b715-36e357399997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=a8445f80-1201-4794-b715-36e357399997,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8445f80-12') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lazy-loading 'pci_devices' on Instance uuid daf2b789-eba2-419b-99f6-be8f483151ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:08:40 user nova-compute[73091]:   <uuid>daf2b789-eba2-419b-99f6-be8f483151ba</uuid>
Aug 16 08:08:40 user nova-compute[73091]:   <name>instance-00000004</name>
Aug 16 08:08:40 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:08:40 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:08:40 user nova-compute[73091]:   <metadata>
Aug 16 08:08:40 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:08:40 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:08:40 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherA-server-424441131</nova:name>
Aug 16 08:08:40 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:08:40</nova:creationTime>
Aug 16 08:08:40 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:08:40 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:08:40 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:08:40 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:08:40 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:08:40 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:08:40 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:08:40 user nova-compute[73091]:       <nova:owner>
Aug 16 08:08:40 user nova-compute[73091]:         <nova:user uuid="c5a61e00249d4bc4b14dd0ab5b88e58c">tempest-ServerActionsTestOtherA-534432070-project-member</nova:user>
Aug 16 08:08:40 user nova-compute[73091]:         <nova:project uuid="2fc3a302cc78494296980753b56edb0c">tempest-ServerActionsTestOtherA-534432070</nova:project>
Aug 16 08:08:40 user nova-compute[73091]:       </nova:owner>
Aug 16 08:08:40 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:08:40 user nova-compute[73091]:       <nova:ports>
Aug 16 08:08:40 user nova-compute[73091]:         <nova:port uuid="a8445f80-1201-4794-b715-36e357399997">
Aug 16 08:08:40 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 08:08:40 user nova-compute[73091]:         </nova:port>
Aug 16 08:08:40 user nova-compute[73091]:       </nova:ports>
Aug 16 08:08:40 user nova-compute[73091]:     </nova:instance>
Aug 16 08:08:40 user nova-compute[73091]:   </metadata>
Aug 16 08:08:40 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:08:40 user nova-compute[73091]:     <system>
Aug 16 08:08:40 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:08:40 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:08:40 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:08:40 user nova-compute[73091]:       <entry name="serial">daf2b789-eba2-419b-99f6-be8f483151ba</entry>
Aug 16 08:08:40 user nova-compute[73091]:       <entry name="uuid">daf2b789-eba2-419b-99f6-be8f483151ba</entry>
Aug 16 08:08:40 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:08:40 user nova-compute[73091]:     </system>
Aug 16 08:08:40 user nova-compute[73091]:   </sysinfo>
Aug 16 08:08:40 user nova-compute[73091]:   <os>
Aug 16 08:08:40 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:08:40 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:08:40 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:08:40 user nova-compute[73091]:   </os>
Aug 16 08:08:40 user nova-compute[73091]:   <features>
Aug 16 08:08:40 user nova-compute[73091]:     <acpi/>
Aug 16 08:08:40 user nova-compute[73091]:     <apic/>
Aug 16 08:08:40 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:08:40 user nova-compute[73091]:   </features>
Aug 16 08:08:40 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:08:40 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:08:40 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:08:40 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:08:40 user nova-compute[73091]:   </clock>
Aug 16 08:08:40 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:08:40 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:08:40 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:08:40 user nova-compute[73091]:   </cpu>
Aug 16 08:08:40 user nova-compute[73091]:   <devices>
Aug 16 08:08:40 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:08:40 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:08:40 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk"/>
Aug 16 08:08:40 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:08:40 user nova-compute[73091]:     </disk>
Aug 16 08:08:40 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:08:40 user nova-compute[73091]:       <mac address="fa:16:3e:d2:ee:e5"/>
Aug 16 08:08:40 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:08:40 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:08:40 user nova-compute[73091]:       <target dev="tapa8445f80-12"/>
Aug 16 08:08:40 user nova-compute[73091]:     </interface>
Aug 16 08:08:40 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:08:40 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/console.log" append="off"/>
Aug 16 08:08:40 user nova-compute[73091]:     </serial>
Aug 16 08:08:40 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:08:40 user nova-compute[73091]:     <video>
Aug 16 08:08:40 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:08:40 user nova-compute[73091]:     </video>
Aug 16 08:08:40 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:08:40 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:08:40 user nova-compute[73091]:     </rng>
Aug 16 08:08:40 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:08:40 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:08:40 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:08:40 user nova-compute[73091]:     </memballoon>
Aug 16 08:08:40 user nova-compute[73091]:   </devices>
Aug 16 08:08:40 user nova-compute[73091]: </domain>
Aug 16 08:08:40 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-424441131',display_name='tempest-ServerActionsTestOtherA-server-424441131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-424441131',id=4,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINoJzCi5cbqDbv92eFfW9aMRXJ4/2v0OQ2hSDLpAu4w1/ZPKBMXJyWSrEcsjVc2ims7W5PLPKHUxP3vEgoDrV6EsVr9zR047a1gU5GWukvuMwQeS2cKyebWkm1qMWtR6Q==',key_name='tempest-keypair-1466249258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fc3a302cc78494296980753b56edb0c',ramdisk_id='',reservation_id='r-zq24o2tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-534432070',owner_user_name='tempest-ServerActionsTestOtherA-534432070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5a61e00249d4bc4b14dd0ab5b88e58c',uuid=daf2b789-eba2-419b-99f6-be8f483151ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8445f80-1201-4794-b715-36e357399997", "address": "fa:16:3e:d2:ee:e5", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8445f80-12", "ovs_interfaceid": "a8445f80-1201-4794-b715-36e357399997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converting VIF {"id": "a8445f80-1201-4794-b715-36e357399997", "address": "fa:16:3e:d2:ee:e5", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8445f80-12", "ovs_interfaceid": "a8445f80-1201-4794-b715-36e357399997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=a8445f80-1201-4794-b715-36e357399997,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8445f80-12') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG os_vif [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=a8445f80-1201-4794-b715-36e357399997,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8445f80-12') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8445f80-12, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa8445f80-12, col_values=(('external_ids', {'iface-id': 'a8445f80-1201-4794-b715-36e357399997', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:ee:e5', 'vm-uuid': 'daf2b789-eba2-419b-99f6-be8f483151ba'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:08:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:40 user nova-compute[73091]: INFO os_vif [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=a8445f80-1201-4794-b715-36e357399997,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8445f80-12')
Aug 16 08:08:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:08:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] No VIF found with MAC fa:16:3e:c3:27:58, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:08:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:08:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] No VIF found with MAC fa:16:3e:d2:ee:e5, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:08:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-472df019-b524-44d7-bca8-05cd987eddfd req-9289ed2f-da0c-4aa8-b439-042ba3efac6b service nova] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Updated VIF entry in instance network info cache for port 75463757-0a11-47fa-8270-d756556eb589. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:08:42 user nova-compute[73091]: DEBUG nova.network.neutron [req-472df019-b524-44d7-bca8-05cd987eddfd req-9289ed2f-da0c-4aa8-b439-042ba3efac6b service nova] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Updating instance_info_cache with network_info: [{"id": "75463757-0a11-47fa-8270-d756556eb589", "address": "fa:16:3e:c3:27:58", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75463757-0a", "ovs_interfaceid": "75463757-0a11-47fa-8270-d756556eb589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:08:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-472df019-b524-44d7-bca8-05cd987eddfd req-9289ed2f-da0c-4aa8-b439-042ba3efac6b service nova] Releasing lock "refresh_cache-cc7973d9-c703-4345-bf58-ccbe80fd07ac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:08:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:42 user nova-compute[73091]: DEBUG nova.network.neutron [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Successfully created port: 1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:08:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173324.6431916, 4a6248b9-f577-4efd-baa2-eb5eb3e47495 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:08:44 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] VM Resumed (Lifecycle Event)
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:08:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Instance spawned successfully.
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:08:44 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173324.6440046, 4a6248b9-f577-4efd-baa2-eb5eb3e47495 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:08:44 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] VM Started (Lifecycle Event)
Aug 16 08:08:44 user nova-compute[73091]: INFO nova.compute.manager [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Took 17.00 seconds to spawn the instance on the hypervisor.
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:08:44 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:08:44 user nova-compute[73091]: INFO nova.compute.manager [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Took 17.84 seconds to build instance.
Aug 16 08:08:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Successfully updated port: 1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4a6eb3f6-3911-4375-8125-d6c306e96942 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.569s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquired lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:08:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:08:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-25f27f1b-4336-47fa-9ff7-db0e4a9421b4 req-1348a543-07e5-4203-8545-11c4cfa9ec3b service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-changed-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:08:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-25f27f1b-4336-47fa-9ff7-db0e4a9421b4 req-1348a543-07e5-4203-8545-11c4cfa9ec3b service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Refreshing instance network info cache due to event network-changed-1acfd5b5-3ae9-44d0-822d-7382be3fd551. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:08:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-25f27f1b-4336-47fa-9ff7-db0e4a9421b4 req-1348a543-07e5-4203-8545-11c4cfa9ec3b service nova] Acquiring lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:08:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:08:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173326.2278292, bd541280-cecf-4c1c-bd1f-f7edff830f1e => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:08:46 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] VM Resumed (Lifecycle Event)
Aug 16 08:08:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Instance spawned successfully.
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating instance_info_cache with network_info: [{"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Releasing lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Instance network_info: |[{"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-25f27f1b-4336-47fa-9ff7-db0e4a9421b4 req-1348a543-07e5-4203-8545-11c4cfa9ec3b service nova] Acquired lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.network.neutron [req-25f27f1b-4336-47fa-9ff7-db0e4a9421b4 req-1348a543-07e5-4203-8545-11c4cfa9ec3b service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Refreshing network info cache for port 1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Start _get_guest_xml network_info=[{"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:08:46 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173326.2279363, bd541280-cecf-4c1c-bd1f-f7edff830f1e => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:08:46 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] VM Started (Lifecycle Event)
Aug 16 08:08:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:08:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1087600235',display_name='tempest-ServerActionsTestOtherB-server-1087600235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1087600235',id=5,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYOKpfDgZmCpH8NYnZIDX4Q6r6QSrYp8+9Ju9pcp2BTpCW6+zgtRofh+/Nl5vfXB2jjGRnF27mUoD5eGzz9iJpQmGeAh8YbRVeP6cdUfPheYKUhiI9ogz9BCberiIkZFg==',key_name='tempest-keypair-657367706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec0498ad9dc84c56ad076bae8fd158a8',ramdisk_id='',reservation_id='r-wwzf0so4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1828527690',owner_user_name='tempest-ServerActionsTestOtherB-1828527690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18882b1744742dbb0b5d157aed696a1',uuid=476de8ea-30dd-4b52-be37-f134e445757f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converting VIF {"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.objects.instance [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lazy-loading 'pci_devices' on Instance uuid 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:08:46 user nova-compute[73091]:   <uuid>476de8ea-30dd-4b52-be37-f134e445757f</uuid>
Aug 16 08:08:46 user nova-compute[73091]:   <name>instance-00000005</name>
Aug 16 08:08:46 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:08:46 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:08:46 user nova-compute[73091]:   <metadata>
Aug 16 08:08:46 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:08:46 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:08:46 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherB-server-1087600235</nova:name>
Aug 16 08:08:46 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:08:46</nova:creationTime>
Aug 16 08:08:46 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:08:46 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:08:46 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:08:46 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:08:46 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:08:46 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:08:46 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:08:46 user nova-compute[73091]:       <nova:owner>
Aug 16 08:08:46 user nova-compute[73091]:         <nova:user uuid="c18882b1744742dbb0b5d157aed696a1">tempest-ServerActionsTestOtherB-1828527690-project-member</nova:user>
Aug 16 08:08:46 user nova-compute[73091]:         <nova:project uuid="ec0498ad9dc84c56ad076bae8fd158a8">tempest-ServerActionsTestOtherB-1828527690</nova:project>
Aug 16 08:08:46 user nova-compute[73091]:       </nova:owner>
Aug 16 08:08:46 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:08:46 user nova-compute[73091]:       <nova:ports>
Aug 16 08:08:46 user nova-compute[73091]:         <nova:port uuid="1acfd5b5-3ae9-44d0-822d-7382be3fd551">
Aug 16 08:08:46 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 08:08:46 user nova-compute[73091]:         </nova:port>
Aug 16 08:08:46 user nova-compute[73091]:       </nova:ports>
Aug 16 08:08:46 user nova-compute[73091]:     </nova:instance>
Aug 16 08:08:46 user nova-compute[73091]:   </metadata>
Aug 16 08:08:46 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:08:46 user nova-compute[73091]:     <system>
Aug 16 08:08:46 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:08:46 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:08:46 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:08:46 user nova-compute[73091]:       <entry name="serial">476de8ea-30dd-4b52-be37-f134e445757f</entry>
Aug 16 08:08:46 user nova-compute[73091]:       <entry name="uuid">476de8ea-30dd-4b52-be37-f134e445757f</entry>
Aug 16 08:08:46 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:08:46 user nova-compute[73091]:     </system>
Aug 16 08:08:46 user nova-compute[73091]:   </sysinfo>
Aug 16 08:08:46 user nova-compute[73091]:   <os>
Aug 16 08:08:46 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:08:46 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:08:46 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:08:46 user nova-compute[73091]:   </os>
Aug 16 08:08:46 user nova-compute[73091]:   <features>
Aug 16 08:08:46 user nova-compute[73091]:     <acpi/>
Aug 16 08:08:46 user nova-compute[73091]:     <apic/>
Aug 16 08:08:46 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:08:46 user nova-compute[73091]:   </features>
Aug 16 08:08:46 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:08:46 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:08:46 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:08:46 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:08:46 user nova-compute[73091]:   </clock>
Aug 16 08:08:46 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:08:46 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:08:46 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:08:46 user nova-compute[73091]:   </cpu>
Aug 16 08:08:46 user nova-compute[73091]:   <devices>
Aug 16 08:08:46 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:08:46 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:08:46 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk"/>
Aug 16 08:08:46 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:08:46 user nova-compute[73091]:     </disk>
Aug 16 08:08:46 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:08:46 user nova-compute[73091]:       <mac address="fa:16:3e:58:35:e3"/>
Aug 16 08:08:46 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:08:46 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:08:46 user nova-compute[73091]:       <target dev="tap1acfd5b5-3a"/>
Aug 16 08:08:46 user nova-compute[73091]:     </interface>
Aug 16 08:08:46 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:08:46 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/console.log" append="off"/>
Aug 16 08:08:46 user nova-compute[73091]:     </serial>
Aug 16 08:08:46 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:08:46 user nova-compute[73091]:     <video>
Aug 16 08:08:46 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:08:46 user nova-compute[73091]:     </video>
Aug 16 08:08:46 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:08:46 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:08:46 user nova-compute[73091]:     </rng>
Aug 16 08:08:46 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:08:46 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:08:46 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:08:46 user nova-compute[73091]:     </memballoon>
Aug 16 08:08:46 user nova-compute[73091]:   </devices>
Aug 16 08:08:46 user nova-compute[73091]: </domain>
Aug 16 08:08:46 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1087600235',display_name='tempest-ServerActionsTestOtherB-server-1087600235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1087600235',id=5,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYOKpfDgZmCpH8NYnZIDX4Q6r6QSrYp8+9Ju9pcp2BTpCW6+zgtRofh+/Nl5vfXB2jjGRnF27mUoD5eGzz9iJpQmGeAh8YbRVeP6cdUfPheYKUhiI9ogz9BCberiIkZFg==',key_name='tempest-keypair-657367706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec0498ad9dc84c56ad076bae8fd158a8',ramdisk_id='',reservation_id='r-wwzf0so4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1828527690',owner_user_name='tempest-ServerActionsTestOtherB-1828527690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18882b1744742dbb0b5d157aed696a1',uuid=476de8ea-30dd-4b52-be37-f134e445757f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converting VIF {"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG os_vif [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:08:46 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1acfd5b5-3a, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1acfd5b5-3a, col_values=(('external_ids', {'iface-id': '1acfd5b5-3ae9-44d0-822d-7382be3fd551', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:35:e3', 'vm-uuid': '476de8ea-30dd-4b52-be37-f134e445757f'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:46 user nova-compute[73091]: INFO os_vif [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a')
Aug 16 08:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:46 user nova-compute[73091]: INFO nova.compute.manager [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Took 20.37 seconds to spawn the instance on the hypervisor.
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] No VIF found with MAC fa:16:3e:58:35:e3, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:46 user nova-compute[73091]: INFO nova.compute.manager [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Took 21.41 seconds to build instance.
Aug 16 08:08:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3d357e99-376e-4405-8a9b-3df640ce1ea8 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.712s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173327.1568477, cc7973d9-c703-4345-bf58-ccbe80fd07ac => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:08:47 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] VM Resumed (Lifecycle Event)
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:08:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Instance spawned successfully.
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:47 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173327.1569817, cc7973d9-c703-4345-bf58-ccbe80fd07ac => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:08:47 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] VM Started (Lifecycle Event)
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:08:47 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:08:47 user nova-compute[73091]: INFO nova.compute.manager [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Took 15.41 seconds to spawn the instance on the hypervisor.
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173327.4048817, daf2b789-eba2-419b-99f6-be8f483151ba => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:08:47 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] VM Resumed (Lifecycle Event)
Aug 16 08:08:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Instance spawned successfully.
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:08:47 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173327.4063852, daf2b789-eba2-419b-99f6-be8f483151ba => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:08:47 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] VM Started (Lifecycle Event)
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:47 user nova-compute[73091]: INFO nova.compute.manager [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Took 10.76 seconds to spawn the instance on the hypervisor.
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:47 user nova-compute[73091]: INFO nova.compute.manager [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Took 16.37 seconds to build instance.
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:08:47 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:08:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-28223158-975b-40d7-ab83-8ba3e579ccf4 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "cc7973d9-c703-4345-bf58-ccbe80fd07ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.597s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:47 user nova-compute[73091]: INFO nova.compute.manager [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Took 11.56 seconds to build instance.
Aug 16 08:08:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d9c866ff-6fe8-4abd-8fec-611dad896f64 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "daf2b789-eba2-419b-99f6-be8f483151ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.696s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.network.neutron [req-25f27f1b-4336-47fa-9ff7-db0e4a9421b4 req-1348a543-07e5-4203-8545-11c4cfa9ec3b service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updated VIF entry in instance network info cache for port 1acfd5b5-3ae9-44d0-822d-7382be3fd551. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG nova.network.neutron [req-25f27f1b-4336-47fa-9ff7-db0e4a9421b4 req-1348a543-07e5-4203-8545-11c4cfa9ec3b service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating instance_info_cache with network_info: [{"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:08:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-25f27f1b-4336-47fa-9ff7-db0e4a9421b4 req-1348a543-07e5-4203-8545-11c4cfa9ec3b service nova] Releasing lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:08:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173331.357451, 476de8ea-30dd-4b52-be37-f134e445757f => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:08:51 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] VM Resumed (Lifecycle Event)
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:08:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Instance spawned successfully.
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:08:51 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173331.3592224, 476de8ea-30dd-4b52-be37-f134e445757f => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:08:51 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] VM Started (Lifecycle Event)
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:08:51 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:08:51 user nova-compute[73091]: INFO nova.compute.manager [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Took 12.79 seconds to spawn the instance on the hypervisor.
Aug 16 08:08:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:08:51 user nova-compute[73091]: INFO nova.compute.manager [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Took 13.80 seconds to build instance.
Aug 16 08:08:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-90b6926c-0feb-464e-a2d5-9e544f96deec tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "476de8ea-30dd-4b52-be37-f134e445757f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.949s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:08:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:08:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "90ad75e0-f191-418b-a970-41fcfd500a77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "90ad75e0-f191-418b-a970-41fcfd500a77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:09:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-fa69822c-2311-485f-9a88-831b85c7ab2a req-feade413-5a3f-4b3b-9f33-eda6cf7eb050 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fa69822c-2311-485f-9a88-831b85c7ab2a req-feade413-5a3f-4b3b-9f33-eda6cf7eb050 service nova] Acquiring lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fa69822c-2311-485f-9a88-831b85c7ab2a req-feade413-5a3f-4b3b-9f33-eda6cf7eb050 service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fa69822c-2311-485f-9a88-831b85c7ab2a req-feade413-5a3f-4b3b-9f33-eda6cf7eb050 service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-fa69822c-2311-485f-9a88-831b85c7ab2a req-feade413-5a3f-4b3b-9f33-eda6cf7eb050 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] No waiting events found dispatching network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:03 user nova-compute[73091]: WARNING nova.compute.manager [req-fa69822c-2311-485f-9a88-831b85c7ab2a req-feade413-5a3f-4b3b-9f33-eda6cf7eb050 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received unexpected event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 for instance with vm_state active and task_state None.
Aug 16 08:09:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:03 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:09:03 user nova-compute[73091]: INFO nova.compute.claims [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Claim successful on node user
Aug 16 08:09:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:09:03 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:09:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Acquiring lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:09:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 16 08:09:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:09:04 user nova-compute[73091]: INFO nova.compute.claims [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Claim successful on node user
Aug 16 08:09:04 user nova-compute[73091]: DEBUG nova.policy [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58c70a06db7b477d8af7dc5cd752443b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55e6435f3eed48fa8fe390b82f4cd3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:09:04 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Creating image(s)
Aug 16 08:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "/opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "/opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "/opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-47e340ee-e406-4e5a-9901-d668a8a138ed req-609e040c-da7d-4f13-9fd4-7ef5148f7934 service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Received event network-vif-plugged-a8445f80-1201-4794-b715-36e357399997 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-47e340ee-e406-4e5a-9901-d668a8a138ed req-609e040c-da7d-4f13-9fd4-7ef5148f7934 service nova] Acquiring lock "daf2b789-eba2-419b-99f6-be8f483151ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-47e340ee-e406-4e5a-9901-d668a8a138ed req-609e040c-da7d-4f13-9fd4-7ef5148f7934 service nova] Lock "daf2b789-eba2-419b-99f6-be8f483151ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-47e340ee-e406-4e5a-9901-d668a8a138ed req-609e040c-da7d-4f13-9fd4-7ef5148f7934 service nova] Lock "daf2b789-eba2-419b-99f6-be8f483151ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-47e340ee-e406-4e5a-9901-d668a8a138ed req-609e040c-da7d-4f13-9fd4-7ef5148f7934 service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] No waiting events found dispatching network-vif-plugged-a8445f80-1201-4794-b715-36e357399997 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:04 user nova-compute[73091]: WARNING nova.compute.manager [req-47e340ee-e406-4e5a-9901-d668a8a138ed req-609e040c-da7d-4f13-9fd4-7ef5148f7934 service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Received unexpected event network-vif-plugged-a8445f80-1201-4794-b715-36e357399997 for instance with vm_state active and task_state None.
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6.part --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6.part --force-share --output=json" returned: 0 in 0.259s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.virt.images [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] eb652581-f331-4ee9-a571-6a0d5aceb168 was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6.part /opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6.converted {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Acquiring lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] No waiting events found dispatching network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:05 user nova-compute[73091]: WARNING nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received unexpected event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 for instance with vm_state active and task_state None.
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Received event network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Acquiring lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] No waiting events found dispatching network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:05 user nova-compute[73091]: WARNING nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Received unexpected event network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d for instance with vm_state active and task_state None.
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Received event network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Acquiring lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] No waiting events found dispatching network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:05 user nova-compute[73091]: WARNING nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Received unexpected event network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d for instance with vm_state active and task_state None.
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Received event network-vif-plugged-75463757-0a11-47fa-8270-d756556eb589 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Acquiring lock "cc7973d9-c703-4345-bf58-ccbe80fd07ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Lock "cc7973d9-c703-4345-bf58-ccbe80fd07ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Lock "cc7973d9-c703-4345-bf58-ccbe80fd07ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] No waiting events found dispatching network-vif-plugged-75463757-0a11-47fa-8270-d756556eb589 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:05 user nova-compute[73091]: WARNING nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Received unexpected event network-vif-plugged-75463757-0a11-47fa-8270-d756556eb589 for instance with vm_state active and task_state None.
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Received event network-vif-plugged-75463757-0a11-47fa-8270-d756556eb589 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Acquiring lock "cc7973d9-c703-4345-bf58-ccbe80fd07ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Lock "cc7973d9-c703-4345-bf58-ccbe80fd07ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] Lock "cc7973d9-c703-4345-bf58-ccbe80fd07ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] No waiting events found dispatching network-vif-plugged-75463757-0a11-47fa-8270-d756556eb589 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:05 user nova-compute[73091]: WARNING nova.compute.manager [req-d7892942-f9b1-45af-86a2-713afd8d7a2a req-33863e5b-8739-4943-8eb6-f8cb39a79cda service nova] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Received unexpected event network-vif-plugged-75463757-0a11-47fa-8270-d756556eb589 for instance with vm_state active and task_state None.
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.189s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6.part /opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6.converted" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6.converted --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:09:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.283s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:09:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Creating image(s)
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "/opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "/opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6 --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG nova.policy [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce62fe92b9c64cb9bf3eb51c125944b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22a1ba2cdb847069b9569ab9fb1aa21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6 --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6,backing_fmt=raw /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6,backing_fmt=raw /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk 1073741824" returned: 0 in 0.052s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.236s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk 1073741824" returned: 0 in 0.051s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f8f3e7c2ebdeaa7bbedce2ec335110b8df86bc6 --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Cannot resize image /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lazy-loading 'migration_context' on Instance uuid 90ad75e0-f191-418b-a970-41fcfd500a77 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Ensure instance console log exists: /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Cannot resize image /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lazy-loading 'migration_context' on Instance uuid b4e06e3b-5389-4054-aa47-d9cf7b638c0f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Ensure instance console log exists: /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-774a0dd9-cb99-429f-96d7-2e50e3027be0 req-4a9ea706-0335-45a8-a71a-a1d0cc4ed8e3 service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Received event network-vif-plugged-a8445f80-1201-4794-b715-36e357399997 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-774a0dd9-cb99-429f-96d7-2e50e3027be0 req-4a9ea706-0335-45a8-a71a-a1d0cc4ed8e3 service nova] Acquiring lock "daf2b789-eba2-419b-99f6-be8f483151ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-774a0dd9-cb99-429f-96d7-2e50e3027be0 req-4a9ea706-0335-45a8-a71a-a1d0cc4ed8e3 service nova] Lock "daf2b789-eba2-419b-99f6-be8f483151ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-774a0dd9-cb99-429f-96d7-2e50e3027be0 req-4a9ea706-0335-45a8-a71a-a1d0cc4ed8e3 service nova] Lock "daf2b789-eba2-419b-99f6-be8f483151ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-774a0dd9-cb99-429f-96d7-2e50e3027be0 req-4a9ea706-0335-45a8-a71a-a1d0cc4ed8e3 service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] No waiting events found dispatching network-vif-plugged-a8445f80-1201-4794-b715-36e357399997 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:06 user nova-compute[73091]: WARNING nova.compute.manager [req-774a0dd9-cb99-429f-96d7-2e50e3027be0 req-4a9ea706-0335-45a8-a71a-a1d0cc4ed8e3 service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Received unexpected event network-vif-plugged-a8445f80-1201-4794-b715-36e357399997 for instance with vm_state active and task_state None.
Aug 16 08:09:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Successfully created port: f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Successfully created port: 1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc7e93f1-5858-49ae-afb4-39567ed0b4b9 req-0b22a8f2-be97-4b20-bb4e-8aa61c8c95c0 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc7e93f1-5858-49ae-afb4-39567ed0b4b9 req-0b22a8f2-be97-4b20-bb4e-8aa61c8c95c0 service nova] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc7e93f1-5858-49ae-afb4-39567ed0b4b9 req-0b22a8f2-be97-4b20-bb4e-8aa61c8c95c0 service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc7e93f1-5858-49ae-afb4-39567ed0b4b9 req-0b22a8f2-be97-4b20-bb4e-8aa61c8c95c0 service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc7e93f1-5858-49ae-afb4-39567ed0b4b9 req-0b22a8f2-be97-4b20-bb4e-8aa61c8c95c0 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] No waiting events found dispatching network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:07 user nova-compute[73091]: WARNING nova.compute.manager [req-cc7e93f1-5858-49ae-afb4-39567ed0b4b9 req-0b22a8f2-be97-4b20-bb4e-8aa61c8c95c0 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received unexpected event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 for instance with vm_state active and task_state None.
Aug 16 08:09:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc7e93f1-5858-49ae-afb4-39567ed0b4b9 req-0b22a8f2-be97-4b20-bb4e-8aa61c8c95c0 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc7e93f1-5858-49ae-afb4-39567ed0b4b9 req-0b22a8f2-be97-4b20-bb4e-8aa61c8c95c0 service nova] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc7e93f1-5858-49ae-afb4-39567ed0b4b9 req-0b22a8f2-be97-4b20-bb4e-8aa61c8c95c0 service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc7e93f1-5858-49ae-afb4-39567ed0b4b9 req-0b22a8f2-be97-4b20-bb4e-8aa61c8c95c0 service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc7e93f1-5858-49ae-afb4-39567ed0b4b9 req-0b22a8f2-be97-4b20-bb4e-8aa61c8c95c0 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] No waiting events found dispatching network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:07 user nova-compute[73091]: WARNING nova.compute.manager [req-cc7e93f1-5858-49ae-afb4-39567ed0b4b9 req-0b22a8f2-be97-4b20-bb4e-8aa61c8c95c0 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received unexpected event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 for instance with vm_state active and task_state None.
Aug 16 08:09:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Successfully updated port: f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Acquiring lock "refresh_cache-b4e06e3b-5389-4054-aa47-d9cf7b638c0f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Acquired lock "refresh_cache-b4e06e3b-5389-4054-aa47-d9cf7b638c0f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:09:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Updating instance_info_cache with network_info: [{"id": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "address": "fa:16:3e:a4:45:19", "network": {"id": "c88e54d4-1e76-4448-9ff8-28b8a98e4fbf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1243695789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22a1ba2cdb847069b9569ab9fb1aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf79f747e-95", "ovs_interfaceid": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Releasing lock "refresh_cache-b4e06e3b-5389-4054-aa47-d9cf7b638c0f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Instance network_info: |[{"id": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "address": "fa:16:3e:a4:45:19", "network": {"id": "c88e54d4-1e76-4448-9ff8-28b8a98e4fbf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1243695789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22a1ba2cdb847069b9569ab9fb1aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf79f747e-95", "ovs_interfaceid": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Start _get_guest_xml network_info=[{"id": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "address": "fa:16:3e:a4:45:19", "network": {"id": "c88e54d4-1e76-4448-9ff8-28b8a98e4fbf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1243695789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22a1ba2cdb847069b9569ab9fb1aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf79f747e-95", "ovs_interfaceid": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:09:08 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:09:08 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-241928249',display_name='tempest-VolumesAssistedSnapshotsTest-server-241928249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-241928249',id=7,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCJDbi5MnIfN3Wpi7R5r0WCI1NXaEwyFLWFnLORYIeXcThgPhGirGb2Cq1WYjTAt2MEFEhpfCtRdsEzkj34+OeB1XmkV/p0pc9kzTHX2IWO7rSCSbE3+S6eToS5PS85qw==',key_name='tempest-keypair-1208312729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22a1ba2cdb847069b9569ab9fb1aa21',ramdisk_id='',reservation_id='r-eqy5z0kz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1268010047',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1268010047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce62fe92b9c64cb9bf3eb51c125944b3',uuid=b4e06e3b-5389-4054-aa47-d9cf7b638c0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "address": "fa:16:3e:a4:45:19", "network": {"id": "c88e54d4-1e76-4448-9ff8-28b8a98e4fbf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1243695789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22a1ba2cdb847069b9569ab9fb1aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf79f747e-95", "ovs_interfaceid": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Converting VIF {"id": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "address": "fa:16:3e:a4:45:19", "network": {"id": "c88e54d4-1e76-4448-9ff8-28b8a98e4fbf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1243695789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22a1ba2cdb847069b9569ab9fb1aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf79f747e-95", "ovs_interfaceid": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:45:19,bridge_name='br-int',has_traffic_filtering=True,id=f79f747e-9580-4ea0-95a5-d70f3564ebca,network=Network(c88e54d4-1e76-4448-9ff8-28b8a98e4fbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf79f747e-95') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lazy-loading 'pci_devices' on Instance uuid b4e06e3b-5389-4054-aa47-d9cf7b638c0f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:09:08 user nova-compute[73091]:   <uuid>b4e06e3b-5389-4054-aa47-d9cf7b638c0f</uuid>
Aug 16 08:09:08 user nova-compute[73091]:   <name>instance-00000007</name>
Aug 16 08:09:08 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:09:08 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:09:08 user nova-compute[73091]:   <metadata>
Aug 16 08:09:08 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:09:08 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:09:08 user nova-compute[73091]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-241928249</nova:name>
Aug 16 08:09:08 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:09:08</nova:creationTime>
Aug 16 08:09:08 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:09:08 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:09:08 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:09:08 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:09:08 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:09:08 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:09:08 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:09:08 user nova-compute[73091]:       <nova:owner>
Aug 16 08:09:08 user nova-compute[73091]:         <nova:user uuid="ce62fe92b9c64cb9bf3eb51c125944b3">tempest-VolumesAssistedSnapshotsTest-1268010047-project-member</nova:user>
Aug 16 08:09:08 user nova-compute[73091]:         <nova:project uuid="e22a1ba2cdb847069b9569ab9fb1aa21">tempest-VolumesAssistedSnapshotsTest-1268010047</nova:project>
Aug 16 08:09:08 user nova-compute[73091]:       </nova:owner>
Aug 16 08:09:08 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:09:08 user nova-compute[73091]:       <nova:ports>
Aug 16 08:09:08 user nova-compute[73091]:         <nova:port uuid="f79f747e-9580-4ea0-95a5-d70f3564ebca">
Aug 16 08:09:08 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 08:09:08 user nova-compute[73091]:         </nova:port>
Aug 16 08:09:08 user nova-compute[73091]:       </nova:ports>
Aug 16 08:09:08 user nova-compute[73091]:     </nova:instance>
Aug 16 08:09:08 user nova-compute[73091]:   </metadata>
Aug 16 08:09:08 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:09:08 user nova-compute[73091]:     <system>
Aug 16 08:09:08 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:09:08 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:09:08 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:09:08 user nova-compute[73091]:       <entry name="serial">b4e06e3b-5389-4054-aa47-d9cf7b638c0f</entry>
Aug 16 08:09:08 user nova-compute[73091]:       <entry name="uuid">b4e06e3b-5389-4054-aa47-d9cf7b638c0f</entry>
Aug 16 08:09:08 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:09:08 user nova-compute[73091]:     </system>
Aug 16 08:09:08 user nova-compute[73091]:   </sysinfo>
Aug 16 08:09:08 user nova-compute[73091]:   <os>
Aug 16 08:09:08 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:09:08 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:09:08 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:09:08 user nova-compute[73091]:   </os>
Aug 16 08:09:08 user nova-compute[73091]:   <features>
Aug 16 08:09:08 user nova-compute[73091]:     <acpi/>
Aug 16 08:09:08 user nova-compute[73091]:     <apic/>
Aug 16 08:09:08 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:09:08 user nova-compute[73091]:   </features>
Aug 16 08:09:08 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:09:08 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:09:08 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:09:08 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:09:08 user nova-compute[73091]:   </clock>
Aug 16 08:09:08 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:09:08 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:09:08 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:09:08 user nova-compute[73091]:   </cpu>
Aug 16 08:09:08 user nova-compute[73091]:   <devices>
Aug 16 08:09:08 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:09:08 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:09:08 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk"/>
Aug 16 08:09:08 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:09:08 user nova-compute[73091]:     </disk>
Aug 16 08:09:08 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:09:08 user nova-compute[73091]:       <mac address="fa:16:3e:a4:45:19"/>
Aug 16 08:09:08 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:09:08 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:09:08 user nova-compute[73091]:       <target dev="tapf79f747e-95"/>
Aug 16 08:09:08 user nova-compute[73091]:     </interface>
Aug 16 08:09:08 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:09:08 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/console.log" append="off"/>
Aug 16 08:09:08 user nova-compute[73091]:     </serial>
Aug 16 08:09:08 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:09:08 user nova-compute[73091]:     <video>
Aug 16 08:09:08 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:09:08 user nova-compute[73091]:     </video>
Aug 16 08:09:08 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:09:08 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:09:08 user nova-compute[73091]:     </rng>
Aug 16 08:09:08 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:09:08 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:09:08 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:09:08 user nova-compute[73091]:     </memballoon>
Aug 16 08:09:08 user nova-compute[73091]:   </devices>
Aug 16 08:09:08 user nova-compute[73091]: </domain>
Aug 16 08:09:08 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-241928249',display_name='tempest-VolumesAssistedSnapshotsTest-server-241928249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-241928249',id=7,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCJDbi5MnIfN3Wpi7R5r0WCI1NXaEwyFLWFnLORYIeXcThgPhGirGb2Cq1WYjTAt2MEFEhpfCtRdsEzkj34+OeB1XmkV/p0pc9kzTHX2IWO7rSCSbE3+S6eToS5PS85qw==',key_name='tempest-keypair-1208312729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22a1ba2cdb847069b9569ab9fb1aa21',ramdisk_id='',reservation_id='r-eqy5z0kz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1268010047',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1268010047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce62fe92b9c64cb9bf3eb51c125944b3',uuid=b4e06e3b-5389-4054-aa47-d9cf7b638c0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "address": "fa:16:3e:a4:45:19", "network": {"id": "c88e54d4-1e76-4448-9ff8-28b8a98e4fbf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1243695789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22a1ba2cdb847069b9569ab9fb1aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf79f747e-95", "ovs_interfaceid": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Converting VIF {"id": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "address": "fa:16:3e:a4:45:19", "network": {"id": "c88e54d4-1e76-4448-9ff8-28b8a98e4fbf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1243695789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22a1ba2cdb847069b9569ab9fb1aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf79f747e-95", "ovs_interfaceid": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:45:19,bridge_name='br-int',has_traffic_filtering=True,id=f79f747e-9580-4ea0-95a5-d70f3564ebca,network=Network(c88e54d4-1e76-4448-9ff8-28b8a98e4fbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf79f747e-95') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG os_vif [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:45:19,bridge_name='br-int',has_traffic_filtering=True,id=f79f747e-9580-4ea0-95a5-d70f3564ebca,network=Network(c88e54d4-1e76-4448-9ff8-28b8a98e4fbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf79f747e-95') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf79f747e-95, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf79f747e-95, col_values=(('external_ids', {'iface-id': 'f79f747e-9580-4ea0-95a5-d70f3564ebca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:45:19', 'vm-uuid': 'b4e06e3b-5389-4054-aa47-d9cf7b638c0f'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:08 user nova-compute[73091]: INFO os_vif [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:45:19,bridge_name='br-int',has_traffic_filtering=True,id=f79f747e-9580-4ea0-95a5-d70f3564ebca,network=Network(c88e54d4-1e76-4448-9ff8-28b8a98e4fbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf79f747e-95')
Aug 16 08:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquiring lock "6060dcaf-e451-4308-b96f-43bcbf56d621" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] No VIF found with MAC fa:16:3e:a4:45:19, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Successfully updated port: 1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "refresh_cache-90ad75e0-f191-418b-a970-41fcfd500a77" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquired lock "refresh_cache-90ad75e0-f191-418b-a970-41fcfd500a77" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:09:08 user nova-compute[73091]: INFO nova.compute.claims [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Claim successful on node user
Aug 16 08:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-4d86f727-db1f-418a-aad1-d826d4e00ff5 req-52545414-3450-467b-8903-abf895ac23cf service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Received event network-changed-1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-4d86f727-db1f-418a-aad1-d826d4e00ff5 req-52545414-3450-467b-8903-abf895ac23cf service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Refreshing instance network info cache due to event network-changed-1c7727db-9b7f-44b2-a649-2042dc3553bb. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d86f727-db1f-418a-aad1-d826d4e00ff5 req-52545414-3450-467b-8903-abf895ac23cf service nova] Acquiring lock "refresh_cache-90ad75e0-f191-418b-a970-41fcfd500a77" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.439s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:09:09 user nova-compute[73091]: INFO nova.compute.claims [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Claim successful on node user
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Updating instance_info_cache with network_info: [{"id": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "address": "fa:16:3e:e1:6f:45", "network": {"id": "5e7781de-6e9b-4788-a042-8db14b7cf340", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1721244661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55e6435f3eed48fa8fe390b82f4cd3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7727db-9b", "ovs_interfaceid": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Releasing lock "refresh_cache-90ad75e0-f191-418b-a970-41fcfd500a77" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Instance network_info: |[{"id": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "address": "fa:16:3e:e1:6f:45", "network": {"id": "5e7781de-6e9b-4788-a042-8db14b7cf340", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1721244661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55e6435f3eed48fa8fe390b82f4cd3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7727db-9b", "ovs_interfaceid": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d86f727-db1f-418a-aad1-d826d4e00ff5 req-52545414-3450-467b-8903-abf895ac23cf service nova] Acquired lock "refresh_cache-90ad75e0-f191-418b-a970-41fcfd500a77" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-4d86f727-db1f-418a-aad1-d826d4e00ff5 req-52545414-3450-467b-8903-abf895ac23cf service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Refreshing network info cache for port 1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Start _get_guest_xml network_info=[{"id": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "address": "fa:16:3e:e1:6f:45", "network": {"id": "5e7781de-6e9b-4788-a042-8db14b7cf340", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1721244661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55e6435f3eed48fa8fe390b82f4cd3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7727db-9b", "ovs_interfaceid": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:08:55Z,direct_url=<?>,disk_format='qcow2',id=eb652581-f331-4ee9-a571-6a0d5aceb168,min_disk=0,min_ram=0,name='',owner='846bf78bf0ec45e8b25b17cc2f89481e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:08:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'guest_format': None, 'device_name': '/dev/sda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': 'eb652581-f331-4ee9-a571-6a0d5aceb168'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:09:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:09:09 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:09:09 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:08:55Z,direct_url=<?>,disk_format='qcow2',id=eb652581-f331-4ee9-a571-6a0d5aceb168,min_disk=0,min_ram=0,name='',owner='846bf78bf0ec45e8b25b17cc2f89481e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:08:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1415630459',display_name='tempest-AttachSCSIVolumeTestJSON-server-1415630459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1415630459',id=6,image_ref='eb652581-f331-4ee9-a571-6a0d5aceb168',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBUD3pL1EUkC43Oem35lMHweYIKTnX+107tRiom3ARXT3ebFNBUUKb0PqEIklB4sBO1VnN/i7s1sxpE/xtPBZ4nWCFW9vWnLzmmvSfA4f92AXAIq3HBkAs9zSQ9sJbirQ==',key_name='tempest-keypair-1179177704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55e6435f3eed48fa8fe390b82f4cd3e4',ramdisk_id='',reservation_id='r-57prlnlq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='eb652581-f331-4ee9-a571-6a0d5aceb168',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1899907715',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1899907715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58c70a06db7b477d8af7dc5cd752443b',uuid=90ad75e0-f191-418b-a970-41fcfd500a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "address": "fa:16:3e:e1:6f:45", "network": {"id": "5e7781de-6e9b-4788-a042-8db14b7cf340", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1721244661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55e6435f3eed48fa8fe390b82f4cd3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7727db-9b", "ovs_interfaceid": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Converting VIF {"id": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "address": "fa:16:3e:e1:6f:45", "network": {"id": "5e7781de-6e9b-4788-a042-8db14b7cf340", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1721244661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55e6435f3eed48fa8fe390b82f4cd3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7727db-9b", "ovs_interfaceid": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6f:45,bridge_name='br-int',has_traffic_filtering=True,id=1c7727db-9b7f-44b2-a649-2042dc3553bb,network=Network(5e7781de-6e9b-4788-a042-8db14b7cf340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c7727db-9b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lazy-loading 'pci_devices' on Instance uuid 90ad75e0-f191-418b-a970-41fcfd500a77 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:09:09 user nova-compute[73091]:   <uuid>90ad75e0-f191-418b-a970-41fcfd500a77</uuid>
Aug 16 08:09:09 user nova-compute[73091]:   <name>instance-00000006</name>
Aug 16 08:09:09 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:09:09 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:09:09 user nova-compute[73091]:   <metadata>
Aug 16 08:09:09 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:09:09 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:09:09 user nova-compute[73091]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1415630459</nova:name>
Aug 16 08:09:09 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:09:09</nova:creationTime>
Aug 16 08:09:09 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:09:09 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:09:09 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:09:09 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:09:09 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:09:09 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:09:09 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:09:09 user nova-compute[73091]:       <nova:owner>
Aug 16 08:09:09 user nova-compute[73091]:         <nova:user uuid="58c70a06db7b477d8af7dc5cd752443b">tempest-AttachSCSIVolumeTestJSON-1899907715-project-member</nova:user>
Aug 16 08:09:09 user nova-compute[73091]:         <nova:project uuid="55e6435f3eed48fa8fe390b82f4cd3e4">tempest-AttachSCSIVolumeTestJSON-1899907715</nova:project>
Aug 16 08:09:09 user nova-compute[73091]:       </nova:owner>
Aug 16 08:09:09 user nova-compute[73091]:       <nova:root type="image" uuid="eb652581-f331-4ee9-a571-6a0d5aceb168"/>
Aug 16 08:09:09 user nova-compute[73091]:       <nova:ports>
Aug 16 08:09:09 user nova-compute[73091]:         <nova:port uuid="1c7727db-9b7f-44b2-a649-2042dc3553bb">
Aug 16 08:09:09 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 08:09:09 user nova-compute[73091]:         </nova:port>
Aug 16 08:09:09 user nova-compute[73091]:       </nova:ports>
Aug 16 08:09:09 user nova-compute[73091]:     </nova:instance>
Aug 16 08:09:09 user nova-compute[73091]:   </metadata>
Aug 16 08:09:09 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:09:09 user nova-compute[73091]:     <system>
Aug 16 08:09:09 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:09:09 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:09:09 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:09:09 user nova-compute[73091]:       <entry name="serial">90ad75e0-f191-418b-a970-41fcfd500a77</entry>
Aug 16 08:09:09 user nova-compute[73091]:       <entry name="uuid">90ad75e0-f191-418b-a970-41fcfd500a77</entry>
Aug 16 08:09:09 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:09:09 user nova-compute[73091]:     </system>
Aug 16 08:09:09 user nova-compute[73091]:   </sysinfo>
Aug 16 08:09:09 user nova-compute[73091]:   <os>
Aug 16 08:09:09 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:09:09 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:09:09 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:09:09 user nova-compute[73091]:   </os>
Aug 16 08:09:09 user nova-compute[73091]:   <features>
Aug 16 08:09:09 user nova-compute[73091]:     <acpi/>
Aug 16 08:09:09 user nova-compute[73091]:     <apic/>
Aug 16 08:09:09 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:09:09 user nova-compute[73091]:   </features>
Aug 16 08:09:09 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:09:09 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:09:09 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:09:09 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:09:09 user nova-compute[73091]:   </clock>
Aug 16 08:09:09 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:09:09 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:09:09 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:09:09 user nova-compute[73091]:   </cpu>
Aug 16 08:09:09 user nova-compute[73091]:   <devices>
Aug 16 08:09:09 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:09:09 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:09:09 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk"/>
Aug 16 08:09:09 user nova-compute[73091]:       <target dev="sda" bus="scsi"/>
Aug 16 08:09:09 user nova-compute[73091]:       <address type="drive" controller="0" unit="0"/>
Aug 16 08:09:09 user nova-compute[73091]:     </disk>
Aug 16 08:09:09 user nova-compute[73091]:     <disk type="file" device="cdrom">
Aug 16 08:09:09 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 08:09:09 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk.config"/>
Aug 16 08:09:09 user nova-compute[73091]:       <target dev="sdb" bus="scsi"/>
Aug 16 08:09:09 user nova-compute[73091]:       <address type="drive" controller="0" unit="1"/>
Aug 16 08:09:09 user nova-compute[73091]:     </disk>
Aug 16 08:09:09 user nova-compute[73091]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 16 08:09:09 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:09:09 user nova-compute[73091]:       <mac address="fa:16:3e:e1:6f:45"/>
Aug 16 08:09:09 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:09:09 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:09:09 user nova-compute[73091]:       <target dev="tap1c7727db-9b"/>
Aug 16 08:09:09 user nova-compute[73091]:     </interface>
Aug 16 08:09:09 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:09:09 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/console.log" append="off"/>
Aug 16 08:09:09 user nova-compute[73091]:     </serial>
Aug 16 08:09:09 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:09:09 user nova-compute[73091]:     <video>
Aug 16 08:09:09 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:09:09 user nova-compute[73091]:     </video>
Aug 16 08:09:09 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:09:09 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:09:09 user nova-compute[73091]:     </rng>
Aug 16 08:09:09 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:09:09 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:09:09 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:09:09 user nova-compute[73091]:     </memballoon>
Aug 16 08:09:09 user nova-compute[73091]:   </devices>
Aug 16 08:09:09 user nova-compute[73091]: </domain>
Aug 16 08:09:09 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1415630459',display_name='tempest-AttachSCSIVolumeTestJSON-server-1415630459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1415630459',id=6,image_ref='eb652581-f331-4ee9-a571-6a0d5aceb168',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBUD3pL1EUkC43Oem35lMHweYIKTnX+107tRiom3ARXT3ebFNBUUKb0PqEIklB4sBO1VnN/i7s1sxpE/xtPBZ4nWCFW9vWnLzmmvSfA4f92AXAIq3HBkAs9zSQ9sJbirQ==',key_name='tempest-keypair-1179177704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55e6435f3eed48fa8fe390b82f4cd3e4',ramdisk_id='',reservation_id='r-57prlnlq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='eb652581-f331-4ee9-a571-6a0d5aceb168',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1899907715',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1899907715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58c70a06db7b477d8af7dc5cd752443b',uuid=90ad75e0-f191-418b-a970-41fcfd500a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "address": "fa:16:3e:e1:6f:45", "network": {"id": "5e7781de-6e9b-4788-a042-8db14b7cf340", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1721244661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55e6435f3eed48fa8fe390b82f4cd3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7727db-9b", "ovs_interfaceid": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Converting VIF {"id": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "address": "fa:16:3e:e1:6f:45", "network": {"id": "5e7781de-6e9b-4788-a042-8db14b7cf340", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1721244661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55e6435f3eed48fa8fe390b82f4cd3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7727db-9b", "ovs_interfaceid": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6f:45,bridge_name='br-int',has_traffic_filtering=True,id=1c7727db-9b7f-44b2-a649-2042dc3553bb,network=Network(5e7781de-6e9b-4788-a042-8db14b7cf340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c7727db-9b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG os_vif [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6f:45,bridge_name='br-int',has_traffic_filtering=True,id=1c7727db-9b7f-44b2-a649-2042dc3553bb,network=Network(5e7781de-6e9b-4788-a042-8db14b7cf340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c7727db-9b') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c7727db-9b, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c7727db-9b, col_values=(('external_ids', {'iface-id': '1c7727db-9b7f-44b2-a649-2042dc3553bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:6f:45', 'vm-uuid': '90ad75e0-f191-418b-a970-41fcfd500a77'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:09 user nova-compute[73091]: INFO os_vif [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6f:45,bridge_name='br-int',has_traffic_filtering=True,id=1c7727db-9b7f-44b2-a649-2042dc3553bb,network=Network(5e7781de-6e9b-4788-a042-8db14b7cf340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c7727db-9b')
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.policy [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '661df8c68df6455e8144ad8e36725f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c313d283deb4669823af7dd855c24e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:09:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Creating image(s)
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "/opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "/opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] No BDM found with device name sda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] No VIF found with MAC fa:16:3e:e1:6f:45, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:09:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Using config drive
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-96f2b03e-551b-46e7-a2b3-608fc4a4acac req-d5aa35ae-e0be-43ce-a8bf-48cccd434b65 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Received event network-changed-f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-96f2b03e-551b-46e7-a2b3-608fc4a4acac req-d5aa35ae-e0be-43ce-a8bf-48cccd434b65 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Refreshing instance network info cache due to event network-changed-f79f747e-9580-4ea0-95a5-d70f3564ebca. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-96f2b03e-551b-46e7-a2b3-608fc4a4acac req-d5aa35ae-e0be-43ce-a8bf-48cccd434b65 service nova] Acquiring lock "refresh_cache-b4e06e3b-5389-4054-aa47-d9cf7b638c0f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-96f2b03e-551b-46e7-a2b3-608fc4a4acac req-d5aa35ae-e0be-43ce-a8bf-48cccd434b65 service nova] Acquired lock "refresh_cache-b4e06e3b-5389-4054-aa47-d9cf7b638c0f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-96f2b03e-551b-46e7-a2b3-608fc4a4acac req-d5aa35ae-e0be-43ce-a8bf-48cccd434b65 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Refreshing network info cache for port f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-4d86f727-db1f-418a-aad1-d826d4e00ff5 req-52545414-3450-467b-8903-abf895ac23cf service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Updated VIF entry in instance network info cache for port 1c7727db-9b7f-44b2-a649-2042dc3553bb. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-4d86f727-db1f-418a-aad1-d826d4e00ff5 req-52545414-3450-467b-8903-abf895ac23cf service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Updating instance_info_cache with network_info: [{"id": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "address": "fa:16:3e:e1:6f:45", "network": {"id": "5e7781de-6e9b-4788-a042-8db14b7cf340", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1721244661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55e6435f3eed48fa8fe390b82f4cd3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7727db-9b", "ovs_interfaceid": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk 1073741824" returned: 0 in 0.060s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d86f727-db1f-418a-aad1-d826d4e00ff5 req-52545414-3450-467b-8903-abf895ac23cf service nova] Releasing lock "refresh_cache-90ad75e0-f191-418b-a970-41fcfd500a77" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Creating config drive at /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk.config
Aug 16 08:09:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprgp0fh5z {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprgp0fh5z" returned: 0 in 0.139s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.240s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:09:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Creating image(s)
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquiring lock "/opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "/opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "/opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG nova.policy [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3e5cf312ea947d7bd695bea3b892664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c792e3e04a0441459b54db9975a0b270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Cannot resize image /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lazy-loading 'migration_context' on Instance uuid a7ae44fc-14fd-457c-8ae7-d8c65df6be2d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Ensure instance console log exists: /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.209s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk 1073741824" returned: 0 in 0.059s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:09:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Cannot resize image /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lazy-loading 'migration_context' on Instance uuid 6060dcaf-e451-4308-b96f-43bcbf56d621 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Ensure instance console log exists: /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG nova.network.neutron [req-96f2b03e-551b-46e7-a2b3-608fc4a4acac req-d5aa35ae-e0be-43ce-a8bf-48cccd434b65 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Updated VIF entry in instance network info cache for port f79f747e-9580-4ea0-95a5-d70f3564ebca. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG nova.network.neutron [req-96f2b03e-551b-46e7-a2b3-608fc4a4acac req-d5aa35ae-e0be-43ce-a8bf-48cccd434b65 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Updating instance_info_cache with network_info: [{"id": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "address": "fa:16:3e:a4:45:19", "network": {"id": "c88e54d4-1e76-4448-9ff8-28b8a98e4fbf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1243695789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22a1ba2cdb847069b9569ab9fb1aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf79f747e-95", "ovs_interfaceid": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-96f2b03e-551b-46e7-a2b3-608fc4a4acac req-d5aa35ae-e0be-43ce-a8bf-48cccd434b65 service nova] Releasing lock "refresh_cache-b4e06e3b-5389-4054-aa47-d9cf7b638c0f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG nova.network.neutron [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Successfully created port: d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-69a7542a-6d77-4195-ae60-ddee97899d1b req-4d517da7-086f-478d-a873-26d9de37e54a service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Received event network-vif-plugged-1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69a7542a-6d77-4195-ae60-ddee97899d1b req-4d517da7-086f-478d-a873-26d9de37e54a service nova] Acquiring lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69a7542a-6d77-4195-ae60-ddee97899d1b req-4d517da7-086f-478d-a873-26d9de37e54a service nova] Lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-69a7542a-6d77-4195-ae60-ddee97899d1b req-4d517da7-086f-478d-a873-26d9de37e54a service nova] Lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-69a7542a-6d77-4195-ae60-ddee97899d1b req-4d517da7-086f-478d-a873-26d9de37e54a service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] No waiting events found dispatching network-vif-plugged-1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:11 user nova-compute[73091]: WARNING nova.compute.manager [req-69a7542a-6d77-4195-ae60-ddee97899d1b req-4d517da7-086f-478d-a873-26d9de37e54a service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Received unexpected event network-vif-plugged-1c7727db-9b7f-44b2-a649-2042dc3553bb for instance with vm_state building and task_state spawning.
Aug 16 08:09:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Successfully created port: 484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Successfully updated port: d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "refresh_cache-a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquired lock "refresh_cache-a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc6d7e1a-dd9d-46be-9f52-72535aeedb42 req-583e80c4-41ac-40a9-b45e-27861afb20ee service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Received event network-changed-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc6d7e1a-dd9d-46be-9f52-72535aeedb42 req-583e80c4-41ac-40a9-b45e-27861afb20ee service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Refreshing instance network info cache due to event network-changed-d8ac0de6-d0c5-4599-88b7-2d6837852ff3. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc6d7e1a-dd9d-46be-9f52-72535aeedb42 req-583e80c4-41ac-40a9-b45e-27861afb20ee service nova] Acquiring lock "refresh_cache-a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "58fb6a40-f818-4515-be92-9f5dd96e40d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:13 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:09:13 user nova-compute[73091]: INFO nova.compute.claims [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Claim successful on node user
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-e0d216b7-679c-479c-be20-9e751a9c036c req-21c7d9b5-16fe-4bfd-98b2-341b3f6ff159 service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Received event network-vif-plugged-1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0d216b7-679c-479c-be20-9e751a9c036c req-21c7d9b5-16fe-4bfd-98b2-341b3f6ff159 service nova] Acquiring lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0d216b7-679c-479c-be20-9e751a9c036c req-21c7d9b5-16fe-4bfd-98b2-341b3f6ff159 service nova] Lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e0d216b7-679c-479c-be20-9e751a9c036c req-21c7d9b5-16fe-4bfd-98b2-341b3f6ff159 service nova] Lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-e0d216b7-679c-479c-be20-9e751a9c036c req-21c7d9b5-16fe-4bfd-98b2-341b3f6ff159 service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] No waiting events found dispatching network-vif-plugged-1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:14 user nova-compute[73091]: WARNING nova.compute.manager [req-e0d216b7-679c-479c-be20-9e751a9c036c req-21c7d9b5-16fe-4bfd-98b2-341b3f6ff159 service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Received unexpected event network-vif-plugged-1c7727db-9b7f-44b2-a649-2042dc3553bb for instance with vm_state building and task_state spawning.
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173354.2397017, b4e06e3b-5389-4054-aa47-d9cf7b638c0f => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:09:14 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] VM Resumed (Lifecycle Event)
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:09:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Instance spawned successfully.
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:14 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173354.2401886, b4e06e3b-5389-4054-aa47-d9cf7b638c0f => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:09:14 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] VM Started (Lifecycle Event)
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:09:14 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:09:14 user nova-compute[73091]: INFO nova.compute.manager [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Took 8.62 seconds to spawn the instance on the hypervisor.
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:09:14 user nova-compute[73091]: INFO nova.compute.manager [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Took 10.30 seconds to build instance.
Aug 16 08:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.723s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4b847f32-55bc-4e33-8dc7-d73792f59e9e tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.506s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Successfully updated port: 484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquiring lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquired lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:09:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-4e1b2be6-1167-443a-b411-5604bd35f457 req-442bbafa-e539-496a-9dad-3bb18183d065 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Received event network-vif-plugged-f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4e1b2be6-1167-443a-b411-5604bd35f457 req-442bbafa-e539-496a-9dad-3bb18183d065 service nova] Acquiring lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4e1b2be6-1167-443a-b411-5604bd35f457 req-442bbafa-e539-496a-9dad-3bb18183d065 service nova] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4e1b2be6-1167-443a-b411-5604bd35f457 req-442bbafa-e539-496a-9dad-3bb18183d065 service nova] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-4e1b2be6-1167-443a-b411-5604bd35f457 req-442bbafa-e539-496a-9dad-3bb18183d065 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] No waiting events found dispatching network-vif-plugged-f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:14 user nova-compute[73091]: WARNING nova.compute.manager [req-4e1b2be6-1167-443a-b411-5604bd35f457 req-442bbafa-e539-496a-9dad-3bb18183d065 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Received unexpected event network-vif-plugged-f79f747e-9580-4ea0-95a5-d70f3564ebca for instance with vm_state active and task_state None.
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173354.7608674, 90ad75e0-f191-418b-a970-41fcfd500a77 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:09:14 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] VM Resumed (Lifecycle Event)
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:09:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Instance spawned successfully.
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:14 user nova-compute[73091]: INFO nova.virt.block_device [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Booting with volume 2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 at /dev/vda
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:09:14 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173354.7630196, 90ad75e0-f191-418b-a970-41fcfd500a77 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:09:14 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] VM Started (Lifecycle Event)
Aug 16 08:09:14 user nova-compute[73091]: INFO nova.compute.manager [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Took 10.47 seconds to spawn the instance on the hypervisor.
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG nova.network.neutron [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Updating instance_info_cache with network_info: [{"id": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "address": "fa:16:3e:3d:e4:37", "network": {"id": "20265325-2c56-4e00-9ef1-bf5dccaab55a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-28492343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c313d283deb4669823af7dd855c24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac0de6-d0", "ovs_interfaceid": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:14 user nova-compute[73091]: DEBUG os_brick.utils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:09:15 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp9c8uolsn/privsep.sock']
Aug 16 08:09:15 user sudo[83659]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp9c8uolsn/privsep.sock
Aug 16 08:09:15 user sudo[83659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 08:09:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Releasing lock "refresh_cache-a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Instance network_info: |[{"id": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "address": "fa:16:3e:3d:e4:37", "network": {"id": "20265325-2c56-4e00-9ef1-bf5dccaab55a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-28492343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c313d283deb4669823af7dd855c24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac0de6-d0", "ovs_interfaceid": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc6d7e1a-dd9d-46be-9f52-72535aeedb42 req-583e80c4-41ac-40a9-b45e-27861afb20ee service nova] Acquired lock "refresh_cache-a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-cc6d7e1a-dd9d-46be-9f52-72535aeedb42 req-583e80c4-41ac-40a9-b45e-27861afb20ee service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Refreshing network info cache for port d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Start _get_guest_xml network_info=[{"id": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "address": "fa:16:3e:3d:e4:37", "network": {"id": "20265325-2c56-4e00-9ef1-bf5dccaab55a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-28492343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c313d283deb4669823af7dd855c24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac0de6-d0", "ovs_interfaceid": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:09:15 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:09:15 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:09:15 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.policy [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb81b27063f549ab938bea843a3ed7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cd0afcf7cd4d06b6914fd69282e6df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2074166526',display_name='tempest-TestVolumeSwap-server-2074166526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2074166526',id=9,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGe9nxmf+SbTX0eV7ugzIHL3tU6jM1S9DqKg36t8XIEp11bOVq8uaW58dsW0L6UI+22Y/adeBacR5UYmuVyn38ZSKbW1ELXAtXdpdFX526PvD/RcuofEOzI333qdh4L7Ag==',key_name='tempest-keypair-1612701411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c313d283deb4669823af7dd855c24e0',ramdisk_id='',reservation_id='r-da18dz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1693011815',owner_user_name='tempest-TestVolumeSwap-1693011815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='661df8c68df6455e8144ad8e36725f7c',uuid=a7ae44fc-14fd-457c-8ae7-d8c65df6be2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "address": "fa:16:3e:3d:e4:37", "network": {"id": "20265325-2c56-4e00-9ef1-bf5dccaab55a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-28492343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c313d283deb4669823af7dd855c24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac0de6-d0", "ovs_interfaceid": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Converting VIF {"id": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "address": "fa:16:3e:3d:e4:37", "network": {"id": "20265325-2c56-4e00-9ef1-bf5dccaab55a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-28492343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c313d283deb4669823af7dd855c24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac0de6-d0", "ovs_interfaceid": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e4:37,bridge_name='br-int',has_traffic_filtering=True,id=d8ac0de6-d0c5-4599-88b7-2d6837852ff3,network=Network(20265325-2c56-4e00-9ef1-bf5dccaab55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ac0de6-d0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lazy-loading 'pci_devices' on Instance uuid a7ae44fc-14fd-457c-8ae7-d8c65df6be2d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:09:15 user nova-compute[73091]: INFO nova.compute.manager [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Took 11.92 seconds to build instance.
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:09:15 user nova-compute[73091]:   <uuid>a7ae44fc-14fd-457c-8ae7-d8c65df6be2d</uuid>
Aug 16 08:09:15 user nova-compute[73091]:   <name>instance-00000009</name>
Aug 16 08:09:15 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:09:15 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:09:15 user nova-compute[73091]:   <metadata>
Aug 16 08:09:15 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:09:15 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:09:15 user nova-compute[73091]:       <nova:name>tempest-TestVolumeSwap-server-2074166526</nova:name>
Aug 16 08:09:15 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:09:15</nova:creationTime>
Aug 16 08:09:15 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:09:15 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:09:15 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:09:15 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:09:15 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:09:15 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:09:15 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:09:15 user nova-compute[73091]:       <nova:owner>
Aug 16 08:09:15 user nova-compute[73091]:         <nova:user uuid="661df8c68df6455e8144ad8e36725f7c">tempest-TestVolumeSwap-1693011815-project-member</nova:user>
Aug 16 08:09:15 user nova-compute[73091]:         <nova:project uuid="9c313d283deb4669823af7dd855c24e0">tempest-TestVolumeSwap-1693011815</nova:project>
Aug 16 08:09:15 user nova-compute[73091]:       </nova:owner>
Aug 16 08:09:15 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:09:15 user nova-compute[73091]:       <nova:ports>
Aug 16 08:09:15 user nova-compute[73091]:         <nova:port uuid="d8ac0de6-d0c5-4599-88b7-2d6837852ff3">
Aug 16 08:09:15 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 08:09:15 user nova-compute[73091]:         </nova:port>
Aug 16 08:09:15 user nova-compute[73091]:       </nova:ports>
Aug 16 08:09:15 user nova-compute[73091]:     </nova:instance>
Aug 16 08:09:15 user nova-compute[73091]:   </metadata>
Aug 16 08:09:15 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:09:15 user nova-compute[73091]:     <system>
Aug 16 08:09:15 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:09:15 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:09:15 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:09:15 user nova-compute[73091]:       <entry name="serial">a7ae44fc-14fd-457c-8ae7-d8c65df6be2d</entry>
Aug 16 08:09:15 user nova-compute[73091]:       <entry name="uuid">a7ae44fc-14fd-457c-8ae7-d8c65df6be2d</entry>
Aug 16 08:09:15 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:09:15 user nova-compute[73091]:     </system>
Aug 16 08:09:15 user nova-compute[73091]:   </sysinfo>
Aug 16 08:09:15 user nova-compute[73091]:   <os>
Aug 16 08:09:15 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:09:15 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:09:15 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:09:15 user nova-compute[73091]:   </os>
Aug 16 08:09:15 user nova-compute[73091]:   <features>
Aug 16 08:09:15 user nova-compute[73091]:     <acpi/>
Aug 16 08:09:15 user nova-compute[73091]:     <apic/>
Aug 16 08:09:15 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:09:15 user nova-compute[73091]:   </features>
Aug 16 08:09:15 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:09:15 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:09:15 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:09:15 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:09:15 user nova-compute[73091]:   </clock>
Aug 16 08:09:15 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:09:15 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:09:15 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:09:15 user nova-compute[73091]:   </cpu>
Aug 16 08:09:15 user nova-compute[73091]:   <devices>
Aug 16 08:09:15 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:09:15 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:09:15 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk"/>
Aug 16 08:09:15 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:09:15 user nova-compute[73091]:     </disk>
Aug 16 08:09:15 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:09:15 user nova-compute[73091]:       <mac address="fa:16:3e:3d:e4:37"/>
Aug 16 08:09:15 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:09:15 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:09:15 user nova-compute[73091]:       <target dev="tapd8ac0de6-d0"/>
Aug 16 08:09:15 user nova-compute[73091]:     </interface>
Aug 16 08:09:15 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:09:15 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/console.log" append="off"/>
Aug 16 08:09:15 user nova-compute[73091]:     </serial>
Aug 16 08:09:15 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:09:15 user nova-compute[73091]:     <video>
Aug 16 08:09:15 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:09:15 user nova-compute[73091]:     </video>
Aug 16 08:09:15 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:09:15 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:09:15 user nova-compute[73091]:     </rng>
Aug 16 08:09:15 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:09:15 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:09:15 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:09:15 user nova-compute[73091]:     </memballoon>
Aug 16 08:09:15 user nova-compute[73091]:   </devices>
Aug 16 08:09:15 user nova-compute[73091]: </domain>
Aug 16 08:09:15 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2074166526',display_name='tempest-TestVolumeSwap-server-2074166526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2074166526',id=9,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGe9nxmf+SbTX0eV7ugzIHL3tU6jM1S9DqKg36t8XIEp11bOVq8uaW58dsW0L6UI+22Y/adeBacR5UYmuVyn38ZSKbW1ELXAtXdpdFX526PvD/RcuofEOzI333qdh4L7Ag==',key_name='tempest-keypair-1612701411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c313d283deb4669823af7dd855c24e0',ramdisk_id='',reservation_id='r-da18dz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1693011815',owner_user_name='tempest-TestVolumeSwap-1693011815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='661df8c68df6455e8144ad8e36725f7c',uuid=a7ae44fc-14fd-457c-8ae7-d8c65df6be2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "address": "fa:16:3e:3d:e4:37", "network": {"id": "20265325-2c56-4e00-9ef1-bf5dccaab55a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-28492343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c313d283deb4669823af7dd855c24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac0de6-d0", "ovs_interfaceid": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Converting VIF {"id": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "address": "fa:16:3e:3d:e4:37", "network": {"id": "20265325-2c56-4e00-9ef1-bf5dccaab55a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-28492343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c313d283deb4669823af7dd855c24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac0de6-d0", "ovs_interfaceid": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e4:37,bridge_name='br-int',has_traffic_filtering=True,id=d8ac0de6-d0c5-4599-88b7-2d6837852ff3,network=Network(20265325-2c56-4e00-9ef1-bf5dccaab55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ac0de6-d0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG os_vif [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e4:37,bridge_name='br-int',has_traffic_filtering=True,id=d8ac0de6-d0c5-4599-88b7-2d6837852ff3,network=Network(20265325-2c56-4e00-9ef1-bf5dccaab55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ac0de6-d0') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8ac0de6-d0, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8ac0de6-d0, col_values=(('external_ids', {'iface-id': 'd8ac0de6-d0c5-4599-88b7-2d6837852ff3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:e4:37', 'vm-uuid': 'a7ae44fc-14fd-457c-8ae7-d8c65df6be2d'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:15 user nova-compute[73091]: INFO os_vif [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e4:37,bridge_name='br-int',has_traffic_filtering=True,id=d8ac0de6-d0c5-4599-88b7-2d6837852ff3,network=Network(20265325-2c56-4e00-9ef1-bf5dccaab55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ac0de6-d0')
Aug 16 08:09:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2a4043c9-dc98-441e-8278-b15a76ce55d7 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "90ad75e0-f191-418b-a970-41fcfd500a77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.200s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] No VIF found with MAC fa:16:3e:3d:e4:37, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-210d99a7-0468-468f-8c80-50123496ea81 req-6cc1ff22-236d-490a-b482-46a2c91b2392 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-changed-484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-210d99a7-0468-468f-8c80-50123496ea81 req-6cc1ff22-236d-490a-b482-46a2c91b2392 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Refreshing instance network info cache due to event network-changed-484c8e2e-4293-41a9-af3c-a6ceb2221a66. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-210d99a7-0468-468f-8c80-50123496ea81 req-6cc1ff22-236d-490a-b482-46a2c91b2392 service nova] Acquiring lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Updating instance_info_cache with network_info: [{"id": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "address": "fa:16:3e:43:ce:db", "network": {"id": "6fa0c4ff-1fbd-499d-ac02-362c7671c238", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-553465889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c8e2e-42", "ovs_interfaceid": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Releasing lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Instance network_info: |[{"id": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "address": "fa:16:3e:43:ce:db", "network": {"id": "6fa0c4ff-1fbd-499d-ac02-362c7671c238", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-553465889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c8e2e-42", "ovs_interfaceid": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-210d99a7-0468-468f-8c80-50123496ea81 req-6cc1ff22-236d-490a-b482-46a2c91b2392 service nova] Acquired lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.network.neutron [req-210d99a7-0468-468f-8c80-50123496ea81 req-6cc1ff22-236d-490a-b482-46a2c91b2392 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Refreshing network info cache for port 484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:09:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Start _get_guest_xml network_info=[{"id": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "address": "fa:16:3e:43:ce:db", "network": {"id": "6fa0c4ff-1fbd-499d-ac02-362c7671c238", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-553465889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c8e2e-42", "ovs_interfaceid": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:09:15 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:09:15 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-533383333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-533383333',id=8,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVA21kXfGbBZ8tCkmT8f3te1Beei+c1JBZA9yX2YdMqwQ7rOdytqAnah4ggCfCIOD5TJSFrM/TOy12XBf1vQaZu3PTuMiXP/NZi01CNr4OGI2WqEhw1bg2TvGRW+Q0clA==',key_name='tempest-keypair-944206026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c792e3e04a0441459b54db9975a0b270',ramdisk_id='',reservation_id='r-0m5hrv3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1641584847',owner_user_name='tempest-TaggedAttachmentsTest-1641584847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3e5cf312ea947d7bd695bea3b892664',uuid=6060dcaf-e451-4308-b96f-43bcbf56d621,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "address": "fa:16:3e:43:ce:db", "network": {"id": "6fa0c4ff-1fbd-499d-ac02-362c7671c238", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-553465889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c8e2e-42", "ovs_interfaceid": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Converting VIF {"id": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "address": "fa:16:3e:43:ce:db", "network": {"id": "6fa0c4ff-1fbd-499d-ac02-362c7671c238", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-553465889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c8e2e-42", "ovs_interfaceid": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ce:db,bridge_name='br-int',has_traffic_filtering=True,id=484c8e2e-4293-41a9-af3c-a6ceb2221a66,network=Network(6fa0c4ff-1fbd-499d-ac02-362c7671c238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484c8e2e-42') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lazy-loading 'pci_devices' on Instance uuid 6060dcaf-e451-4308-b96f-43bcbf56d621 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:09:16 user nova-compute[73091]:   <uuid>6060dcaf-e451-4308-b96f-43bcbf56d621</uuid>
Aug 16 08:09:16 user nova-compute[73091]:   <name>instance-00000008</name>
Aug 16 08:09:16 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:09:16 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:09:16 user nova-compute[73091]:   <metadata>
Aug 16 08:09:16 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:09:16 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:09:16 user nova-compute[73091]:       <nova:name>tempest-device-tagging-server-533383333</nova:name>
Aug 16 08:09:16 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:09:15</nova:creationTime>
Aug 16 08:09:16 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:09:16 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:09:16 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:09:16 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:09:16 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:09:16 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:09:16 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:09:16 user nova-compute[73091]:       <nova:owner>
Aug 16 08:09:16 user nova-compute[73091]:         <nova:user uuid="d3e5cf312ea947d7bd695bea3b892664">tempest-TaggedAttachmentsTest-1641584847-project-member</nova:user>
Aug 16 08:09:16 user nova-compute[73091]:         <nova:project uuid="c792e3e04a0441459b54db9975a0b270">tempest-TaggedAttachmentsTest-1641584847</nova:project>
Aug 16 08:09:16 user nova-compute[73091]:       </nova:owner>
Aug 16 08:09:16 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:09:16 user nova-compute[73091]:       <nova:ports>
Aug 16 08:09:16 user nova-compute[73091]:         <nova:port uuid="484c8e2e-4293-41a9-af3c-a6ceb2221a66">
Aug 16 08:09:16 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 08:09:16 user nova-compute[73091]:         </nova:port>
Aug 16 08:09:16 user nova-compute[73091]:       </nova:ports>
Aug 16 08:09:16 user nova-compute[73091]:     </nova:instance>
Aug 16 08:09:16 user nova-compute[73091]:   </metadata>
Aug 16 08:09:16 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:09:16 user nova-compute[73091]:     <system>
Aug 16 08:09:16 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:09:16 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:09:16 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:09:16 user nova-compute[73091]:       <entry name="serial">6060dcaf-e451-4308-b96f-43bcbf56d621</entry>
Aug 16 08:09:16 user nova-compute[73091]:       <entry name="uuid">6060dcaf-e451-4308-b96f-43bcbf56d621</entry>
Aug 16 08:09:16 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:09:16 user nova-compute[73091]:     </system>
Aug 16 08:09:16 user nova-compute[73091]:   </sysinfo>
Aug 16 08:09:16 user nova-compute[73091]:   <os>
Aug 16 08:09:16 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:09:16 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:09:16 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:09:16 user nova-compute[73091]:   </os>
Aug 16 08:09:16 user nova-compute[73091]:   <features>
Aug 16 08:09:16 user nova-compute[73091]:     <acpi/>
Aug 16 08:09:16 user nova-compute[73091]:     <apic/>
Aug 16 08:09:16 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:09:16 user nova-compute[73091]:   </features>
Aug 16 08:09:16 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:09:16 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:09:16 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:09:16 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:09:16 user nova-compute[73091]:   </clock>
Aug 16 08:09:16 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:09:16 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:09:16 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:09:16 user nova-compute[73091]:   </cpu>
Aug 16 08:09:16 user nova-compute[73091]:   <devices>
Aug 16 08:09:16 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:09:16 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:09:16 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk"/>
Aug 16 08:09:16 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:09:16 user nova-compute[73091]:     </disk>
Aug 16 08:09:16 user nova-compute[73091]:     <disk type="file" device="cdrom">
Aug 16 08:09:16 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 08:09:16 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk.config"/>
Aug 16 08:09:16 user nova-compute[73091]:       <target dev="hda" bus="ide"/>
Aug 16 08:09:16 user nova-compute[73091]:     </disk>
Aug 16 08:09:16 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:09:16 user nova-compute[73091]:       <mac address="fa:16:3e:43:ce:db"/>
Aug 16 08:09:16 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:09:16 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:09:16 user nova-compute[73091]:       <target dev="tap484c8e2e-42"/>
Aug 16 08:09:16 user nova-compute[73091]:     </interface>
Aug 16 08:09:16 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:09:16 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/console.log" append="off"/>
Aug 16 08:09:16 user nova-compute[73091]:     </serial>
Aug 16 08:09:16 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:09:16 user nova-compute[73091]:     <video>
Aug 16 08:09:16 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:09:16 user nova-compute[73091]:     </video>
Aug 16 08:09:16 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:09:16 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:09:16 user nova-compute[73091]:     </rng>
Aug 16 08:09:16 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:09:16 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:09:16 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:09:16 user nova-compute[73091]:     </memballoon>
Aug 16 08:09:16 user nova-compute[73091]:   </devices>
Aug 16 08:09:16 user nova-compute[73091]: </domain>
Aug 16 08:09:16 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-533383333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-533383333',id=8,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVA21kXfGbBZ8tCkmT8f3te1Beei+c1JBZA9yX2YdMqwQ7rOdytqAnah4ggCfCIOD5TJSFrM/TOy12XBf1vQaZu3PTuMiXP/NZi01CNr4OGI2WqEhw1bg2TvGRW+Q0clA==',key_name='tempest-keypair-944206026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c792e3e04a0441459b54db9975a0b270',ramdisk_id='',reservation_id='r-0m5hrv3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1641584847',owner_user_name='tempest-TaggedAttachmentsTest-1641584847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3e5cf312ea947d7bd695bea3b892664',uuid=6060dcaf-e451-4308-b96f-43bcbf56d621,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "address": "fa:16:3e:43:ce:db", "network": {"id": "6fa0c4ff-1fbd-499d-ac02-362c7671c238", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-553465889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c8e2e-42", "ovs_interfaceid": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Converting VIF {"id": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "address": "fa:16:3e:43:ce:db", "network": {"id": "6fa0c4ff-1fbd-499d-ac02-362c7671c238", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-553465889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c8e2e-42", "ovs_interfaceid": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ce:db,bridge_name='br-int',has_traffic_filtering=True,id=484c8e2e-4293-41a9-af3c-a6ceb2221a66,network=Network(6fa0c4ff-1fbd-499d-ac02-362c7671c238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484c8e2e-42') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG os_vif [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ce:db,bridge_name='br-int',has_traffic_filtering=True,id=484c8e2e-4293-41a9-af3c-a6ceb2221a66,network=Network(6fa0c4ff-1fbd-499d-ac02-362c7671c238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484c8e2e-42') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap484c8e2e-42, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap484c8e2e-42, col_values=(('external_ids', {'iface-id': '484c8e2e-4293-41a9-af3c-a6ceb2221a66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:ce:db', 'vm-uuid': '6060dcaf-e451-4308-b96f-43bcbf56d621'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:16 user nova-compute[73091]: INFO os_vif [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ce:db,bridge_name='br-int',has_traffic_filtering=True,id=484c8e2e-4293-41a9-af3c-a6ceb2221a66,network=Network(6fa0c4ff-1fbd-499d-ac02-362c7671c238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484c8e2e-42')
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] No BDM found with device name hda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] No VIF found with MAC fa:16:3e:43:ce:db, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:09:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Using config drive
Aug 16 08:09:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:09:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Creating config drive at /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk.config
Aug 16 08:09:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwz8glc7c {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwz8glc7c" returned: 0 in 0.078s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-5cd78532-b426-4373-a84f-70c551aee338 req-3e76cdef-e137-4993-b67b-420e6c6ea625 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Received event network-vif-plugged-f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5cd78532-b426-4373-a84f-70c551aee338 req-3e76cdef-e137-4993-b67b-420e6c6ea625 service nova] Acquiring lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5cd78532-b426-4373-a84f-70c551aee338 req-3e76cdef-e137-4993-b67b-420e6c6ea625 service nova] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5cd78532-b426-4373-a84f-70c551aee338 req-3e76cdef-e137-4993-b67b-420e6c6ea625 service nova] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-5cd78532-b426-4373-a84f-70c551aee338 req-3e76cdef-e137-4993-b67b-420e6c6ea625 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] No waiting events found dispatching network-vif-plugged-f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:16 user nova-compute[73091]: WARNING nova.compute.manager [req-5cd78532-b426-4373-a84f-70c551aee338 req-3e76cdef-e137-4993-b67b-420e6c6ea625 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Received unexpected event network-vif-plugged-f79f747e-9580-4ea0-95a5-d70f3564ebca for instance with vm_state active and task_state None.
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-cc6d7e1a-dd9d-46be-9f52-72535aeedb42 req-583e80c4-41ac-40a9-b45e-27861afb20ee service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Updated VIF entry in instance network info cache for port d8ac0de6-d0c5-4599-88b7-2d6837852ff3. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG nova.network.neutron [req-cc6d7e1a-dd9d-46be-9f52-72535aeedb42 req-583e80c4-41ac-40a9-b45e-27861afb20ee service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Updating instance_info_cache with network_info: [{"id": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "address": "fa:16:3e:3d:e4:37", "network": {"id": "20265325-2c56-4e00-9ef1-bf5dccaab55a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-28492343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c313d283deb4669823af7dd855c24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac0de6-d0", "ovs_interfaceid": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc6d7e1a-dd9d-46be-9f52-72535aeedb42 req-583e80c4-41ac-40a9-b45e-27861afb20ee service nova] Releasing lock "refresh_cache-a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:17 user sudo[83659]: pam_unix(sudo:session): session closed for user root
Aug 16 08:09:17 user nova-compute[73091]: INFO oslo.privsep.daemon [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Spawned new privsep daemon via rootwrap
Aug 16 08:09:17 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Successfully created port: ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:17 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 08:09:17 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 08:09:17 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 16 08:09:17 user nova-compute[73091]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83685
Aug 16 08:09:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-210d99a7-0468-468f-8c80-50123496ea81 req-6cc1ff22-236d-490a-b482-46a2c91b2392 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Updated VIF entry in instance network info cache for port 484c8e2e-4293-41a9-af3c-a6ceb2221a66. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-210d99a7-0468-468f-8c80-50123496ea81 req-6cc1ff22-236d-490a-b482-46a2c91b2392 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Updating instance_info_cache with network_info: [{"id": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "address": "fa:16:3e:43:ce:db", "network": {"id": "6fa0c4ff-1fbd-499d-ac02-362c7671c238", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-553465889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c8e2e-42", "ovs_interfaceid": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c2c582-85ad-4f8a-b02b-c57e0ac7a480]: (2,) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-210d99a7-0468-468f-8c80-50123496ea81 req-6cc1ff22-236d-490a-b482-46a2c91b2392 service nova] Releasing lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0213becc-bb15-48fe-b3fa-7d8c5bc8eef6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:17 user nova-compute[73091]: WARNING os_brick.initiator.connectors.nvmeof [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f768602-2213-435a-9445-8154da6ed1c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7646d5aa-4a16-4a5b-9f0a-f6922af0a19b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cddfacf-6b6e-4c74-bd99-e462a249b1b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:09:17 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:09:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ade4880-c732-4f22-ad7b-4311c42ce8b5]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG os_brick.utils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] <== get_connector_properties: return (2897ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:09:17 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Updating existing volume attachment record: 68296d3b-e493-4d1a-919c-7ba039d00ecd {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-2f05e166-74eb-4f48-a40c-03b69adc2b0b req-e4e9b21d-b4a9-4d75-8b9e-5275b1e4caef service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Received event network-vif-plugged-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2f05e166-74eb-4f48-a40c-03b69adc2b0b req-e4e9b21d-b4a9-4d75-8b9e-5275b1e4caef service nova] Acquiring lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2f05e166-74eb-4f48-a40c-03b69adc2b0b req-e4e9b21d-b4a9-4d75-8b9e-5275b1e4caef service nova] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2f05e166-74eb-4f48-a40c-03b69adc2b0b req-e4e9b21d-b4a9-4d75-8b9e-5275b1e4caef service nova] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-2f05e166-74eb-4f48-a40c-03b69adc2b0b req-e4e9b21d-b4a9-4d75-8b9e-5275b1e4caef service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] No waiting events found dispatching network-vif-plugged-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:18 user nova-compute[73091]: WARNING nova.compute.manager [req-2f05e166-74eb-4f48-a40c-03b69adc2b0b req-e4e9b21d-b4a9-4d75-8b9e-5275b1e4caef service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Received unexpected event network-vif-plugged-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 for instance with vm_state building and task_state spawning.
Aug 16 08:09:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Successfully updated port: ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "refresh_cache-58fb6a40-f818-4515-be92-9f5dd96e40d6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquired lock "refresh_cache-58fb6a40-f818-4515-be92-9f5dd96e40d6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-012e7dcb-5861-4828-990a-7ba7627d4991 req-9f6526cb-ede4-470c-8b4f-e06f6e187d12 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received event network-changed-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-012e7dcb-5861-4828-990a-7ba7627d4991 req-9f6526cb-ede4-470c-8b4f-e06f6e187d12 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Refreshing instance network info cache due to event network-changed-ff7593ef-acd3-4f60-8f85-e4314751d437. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:09:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-012e7dcb-5861-4828-990a-7ba7627d4991 req-9f6526cb-ede4-470c-8b4f-e06f6e187d12 service nova] Acquiring lock "refresh_cache-58fb6a40-f818-4515-be92-9f5dd96e40d6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:09:19 user nova-compute[73091]: DEBUG nova.network.neutron [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Updating instance_info_cache with network_info: [{"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Releasing lock "refresh_cache-58fb6a40-f818-4515-be92-9f5dd96e40d6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Instance network_info: |[{"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:09:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-012e7dcb-5861-4828-990a-7ba7627d4991 req-9f6526cb-ede4-470c-8b4f-e06f6e187d12 service nova] Acquired lock "refresh_cache-58fb6a40-f818-4515-be92-9f5dd96e40d6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:19 user nova-compute[73091]: DEBUG nova.network.neutron [req-012e7dcb-5861-4828-990a-7ba7627d4991 req-9f6526cb-ede4-470c-8b4f-e06f6e187d12 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Refreshing network info cache for port ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:09:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:20 user nova-compute[73091]: DEBUG nova.network.neutron [req-012e7dcb-5861-4828-990a-7ba7627d4991 req-9f6526cb-ede4-470c-8b4f-e06f6e187d12 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Updated VIF entry in instance network info cache for port ff7593ef-acd3-4f60-8f85-e4314751d437. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:09:20 user nova-compute[73091]: DEBUG nova.network.neutron [req-012e7dcb-5861-4828-990a-7ba7627d4991 req-9f6526cb-ede4-470c-8b4f-e06f6e187d12 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Updating instance_info_cache with network_info: [{"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-012e7dcb-5861-4828-990a-7ba7627d4991 req-9f6526cb-ede4-470c-8b4f-e06f6e187d12 service nova] Releasing lock "refresh_cache-58fb6a40-f818-4515-be92-9f5dd96e40d6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-5c3dc264-9785-4ca7-8313-d1607e366210 req-6aca124c-c8b3-43df-8359-4da2ad496bfc service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Received event network-vif-plugged-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c3dc264-9785-4ca7-8313-d1607e366210 req-6aca124c-c8b3-43df-8359-4da2ad496bfc service nova] Acquiring lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c3dc264-9785-4ca7-8313-d1607e366210 req-6aca124c-c8b3-43df-8359-4da2ad496bfc service nova] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5c3dc264-9785-4ca7-8313-d1607e366210 req-6aca124c-c8b3-43df-8359-4da2ad496bfc service nova] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-5c3dc264-9785-4ca7-8313-d1607e366210 req-6aca124c-c8b3-43df-8359-4da2ad496bfc service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] No waiting events found dispatching network-vif-plugged-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:20 user nova-compute[73091]: WARNING nova.compute.manager [req-5c3dc264-9785-4ca7-8313-d1607e366210 req-6aca124c-c8b3-43df-8359-4da2ad496bfc service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Received unexpected event network-vif-plugged-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 for instance with vm_state building and task_state spawning.
Aug 16 08:09:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173362.1306732, a7ae44fc-14fd-457c-8ae7-d8c65df6be2d => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:09:22 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] VM Resumed (Lifecycle Event)
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Instance spawned successfully.
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:09:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Instance spawned successfully.
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:09:22 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173362.132295, a7ae44fc-14fd-457c-8ae7-d8c65df6be2d => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:09:22 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] VM Started (Lifecycle Event)
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:09:22 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173362.1361175, 6060dcaf-e451-4308-b96f-43bcbf56d621 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:09:22 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] VM Resumed (Lifecycle Event)
Aug 16 08:09:22 user nova-compute[73091]: INFO nova.compute.manager [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Took 12.16 seconds to spawn the instance on the hypervisor.
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:22 user nova-compute[73091]: INFO nova.compute.manager [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Took 12.97 seconds to spawn the instance on the hypervisor.
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:09:22 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173362.1399384, 6060dcaf-e451-4308-b96f-43bcbf56d621 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:09:22 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] VM Started (Lifecycle Event)
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:09:22 user nova-compute[73091]: INFO nova.compute.manager [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Took 13.88 seconds to build instance.
Aug 16 08:09:22 user nova-compute[73091]: INFO nova.compute.manager [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Took 13.99 seconds to build instance.
Aug 16 08:09:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c342c0d0-d705-4f5c-ad77-b9706a714ee1 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.020s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da66735c-49a6-4d6e-a31d-bff2c41716f7 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.158s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:09:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=7532MB free_disk=25.720108032226562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-42d4be10-eb27-4659-9319-20975fad1658 req-87d6b8dd-6471-4f7e-97a0-5fdb8498e79f service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-vif-plugged-484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-42d4be10-eb27-4659-9319-20975fad1658 req-87d6b8dd-6471-4f7e-97a0-5fdb8498e79f service nova] Acquiring lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-42d4be10-eb27-4659-9319-20975fad1658 req-87d6b8dd-6471-4f7e-97a0-5fdb8498e79f service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-42d4be10-eb27-4659-9319-20975fad1658 req-87d6b8dd-6471-4f7e-97a0-5fdb8498e79f service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-42d4be10-eb27-4659-9319-20975fad1658 req-87d6b8dd-6471-4f7e-97a0-5fdb8498e79f service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] No waiting events found dispatching network-vif-plugged-484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:27 user nova-compute[73091]: WARNING nova.compute.manager [req-42d4be10-eb27-4659-9319-20975fad1658 req-87d6b8dd-6471-4f7e-97a0-5fdb8498e79f service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received unexpected event network-vif-plugged-484c8e2e-4293-41a9-af3c-a6ceb2221a66 for instance with vm_state active and task_state None.
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance bd541280-cecf-4c1c-bd1f-f7edff830f1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4a6248b9-f577-4efd-baa2-eb5eb3e47495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance cc7973d9-c703-4345-bf58-ccbe80fd07ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance daf2b789-eba2-419b-99f6-be8f483151ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 476de8ea-30dd-4b52-be37-f134e445757f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 90ad75e0-f191-418b-a970-41fcfd500a77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance b4e06e3b-5389-4054-aa47-d9cf7b638c0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 6060dcaf-e451-4308-b96f-43bcbf56d621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance a7ae44fc-14fd-457c-8ae7-d8c65df6be2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 58fb6a40-f818-4515-be92-9f5dd96e40d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Refreshing inventories for resource provider a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Updating ProviderTree inventory for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Updating inventory in ProviderTree for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Refreshing aggregate associations for resource provider a5935d1e-4613-4ec5-92d3-58605923e4b9, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 08:09:27 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Refreshing trait associations for resource provider a5935d1e-4613-4ec5-92d3-58605923e4b9, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 08:09:28 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:09:28 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:09:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:09:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.281s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:09:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:09:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:09:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 08:09:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Skipping network cache update for instance because it is Building. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 08:09:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-ed547350-3c08-4667-8cd4-558ea5d1443a req-3c9c75b9-4dfd-44e9-94e6-f97a163f13d6 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-vif-plugged-484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ed547350-3c08-4667-8cd4-558ea5d1443a req-3c9c75b9-4dfd-44e9-94e6-f97a163f13d6 service nova] Acquiring lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ed547350-3c08-4667-8cd4-558ea5d1443a req-3c9c75b9-4dfd-44e9-94e6-f97a163f13d6 service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ed547350-3c08-4667-8cd4-558ea5d1443a req-3c9c75b9-4dfd-44e9-94e6-f97a163f13d6 service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-ed547350-3c08-4667-8cd4-558ea5d1443a req-3c9c75b9-4dfd-44e9-94e6-f97a163f13d6 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] No waiting events found dispatching network-vif-plugged-484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:29 user nova-compute[73091]: WARNING nova.compute.manager [req-ed547350-3c08-4667-8cd4-558ea5d1443a req-3c9c75b9-4dfd-44e9-94e6-f97a163f13d6 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received unexpected event network-vif-plugged-484c8e2e-4293-41a9-af3c-a6ceb2221a66 for instance with vm_state active and task_state None.
Aug 16 08:09:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquired lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 08:09:29 user nova-compute[73091]: DEBUG nova.objects.instance [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lazy-loading 'info_cache' on Instance uuid bd541280-cecf-4c1c-bd1f-f7edff830f1e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Updating instance_info_cache with network_info: [{"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Releasing lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:09:30 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Creating image(s)
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Ensure instance console log exists: /opt/stack/data/nova/instances/58fb6a40-f818-4515-be92-9f5dd96e40d6/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Start _get_guest_xml network_info=[{"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '68296d3b-e493-4d1a-919c-7ba039d00ecd', 'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWKlGuEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58fb6a40-f818-4515-be92-9f5dd96e40d6', 'attached_at': '', 'detached_at': '', 'volume_id': '2c00710f-993d-47dc-b3a1-5f6b2e1ccd59', 'serial': '2c00710f-993d-47dc-b3a1-5f6b2e1ccd59'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:09:30 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:09:30 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG os_brick.initiator.connector [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Factory for ISCSI on None {{(pid=73091) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWKlGuEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:09:30 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:09:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:09:30 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:09:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:09:30 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2997f6a2-625c-4204-abe9-b6e8dbc938dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:09:30 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79d8668-070d-4c8a-b9d7-4e2e69f1bb85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59] added
Aug 16 08:09:30 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b863dc-3b53-4b71-9904-e219a2419c26]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:09:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.120s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6507f36a-9f80-47a1-b81a-bf0ca7162e95]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWKlGuEj {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWKlGuEj" returned: 0 in 0.029s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46f8a5a-9387-44b5-8176-0d089e10b65c]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rWKlGuEj'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9979378b-059b-4748-a046-00228502dc5b]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[535608cd-1e8c-418c-8c6e-405fb4084866]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 08:09:31 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 08:09:31 user nova-compute[73091]:  {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:09:31 user nova-compute[73091]: WARNING os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 08:09:31 user nova-compute[73091]: 
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb3ff2c-9e47-4f4c-addd-f9d354cdd9a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260]
Aug 16 08:09:31 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260] successful.
Aug 16 08:09:31 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38c6a86-33fb-45e4-8420-a42b0c0880ff]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf51bf1-c60c-40d2-9728-4ff6661583d1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:09:31 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:09:31 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8b004e-3b42-47d3-aba7-a012917dee19]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:09:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWKlGuEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '26439383538386539', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439383538386539', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-622705224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-622705224',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgwr+lPrpEP5o9ETv2V1lYpdSx5+1jSfz5g40qSuKvSXhEDtmL9vrp71E/TIr7O7WlZ5kcRETw3PrK7xu+z/FUuEGZhJeo4ndVNxGCXeTwKuExSPw6ICDcnszQlQ44bDg==',key_name='tempest-keypair-1739562332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3cd0afcf7cd4d06b6914fd69282e6df',ramdisk_id='',reservation_id='r-j2kcg45t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1659459997',owner_user_name='tempest-ServerActionsV293TestJSON-1659459997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb81b27063f549ab938bea843a3ed7c6',uuid=58fb6a40-f818-4515-be92-9f5dd96e40d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Converting VIF {"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e5:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff7593ef-acd3-4f60-8f85-e4314751d437,network=Network(38194120-0573-40dd-a8f9-78e2afcb9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7593ef-ac') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lazy-loading 'pci_devices' on Instance uuid 58fb6a40-f818-4515-be92-9f5dd96e40d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:09:32 user nova-compute[73091]:   <uuid>58fb6a40-f818-4515-be92-9f5dd96e40d6</uuid>
Aug 16 08:09:32 user nova-compute[73091]:   <name>instance-0000000a</name>
Aug 16 08:09:32 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:09:32 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:09:32 user nova-compute[73091]:   <metadata>
Aug 16 08:09:32 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:09:32 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:09:32 user nova-compute[73091]:       <nova:name>tempest-ServerActionsV293TestJSON-server-622705224</nova:name>
Aug 16 08:09:32 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:09:30</nova:creationTime>
Aug 16 08:09:32 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:09:32 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:09:32 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:09:32 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:09:32 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:09:32 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:09:32 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:09:32 user nova-compute[73091]:       <nova:owner>
Aug 16 08:09:32 user nova-compute[73091]:         <nova:user uuid="eb81b27063f549ab938bea843a3ed7c6">tempest-ServerActionsV293TestJSON-1659459997-project-member</nova:user>
Aug 16 08:09:32 user nova-compute[73091]:         <nova:project uuid="e3cd0afcf7cd4d06b6914fd69282e6df">tempest-ServerActionsV293TestJSON-1659459997</nova:project>
Aug 16 08:09:32 user nova-compute[73091]:       </nova:owner>
Aug 16 08:09:32 user nova-compute[73091]:       <nova:ports>
Aug 16 08:09:32 user nova-compute[73091]:         <nova:port uuid="ff7593ef-acd3-4f60-8f85-e4314751d437">
Aug 16 08:09:32 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 08:09:32 user nova-compute[73091]:         </nova:port>
Aug 16 08:09:32 user nova-compute[73091]:       </nova:ports>
Aug 16 08:09:32 user nova-compute[73091]:     </nova:instance>
Aug 16 08:09:32 user nova-compute[73091]:   </metadata>
Aug 16 08:09:32 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:09:32 user nova-compute[73091]:     <system>
Aug 16 08:09:32 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:09:32 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:09:32 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:09:32 user nova-compute[73091]:       <entry name="serial">58fb6a40-f818-4515-be92-9f5dd96e40d6</entry>
Aug 16 08:09:32 user nova-compute[73091]:       <entry name="uuid">58fb6a40-f818-4515-be92-9f5dd96e40d6</entry>
Aug 16 08:09:32 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:09:32 user nova-compute[73091]:     </system>
Aug 16 08:09:32 user nova-compute[73091]:   </sysinfo>
Aug 16 08:09:32 user nova-compute[73091]:   <os>
Aug 16 08:09:32 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:09:32 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:09:32 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:09:32 user nova-compute[73091]:   </os>
Aug 16 08:09:32 user nova-compute[73091]:   <features>
Aug 16 08:09:32 user nova-compute[73091]:     <acpi/>
Aug 16 08:09:32 user nova-compute[73091]:     <apic/>
Aug 16 08:09:32 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:09:32 user nova-compute[73091]:   </features>
Aug 16 08:09:32 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:09:32 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:09:32 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:09:32 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:09:32 user nova-compute[73091]:   </clock>
Aug 16 08:09:32 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:09:32 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:09:32 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:09:32 user nova-compute[73091]:   </cpu>
Aug 16 08:09:32 user nova-compute[73091]:   <devices>
Aug 16 08:09:32 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:09:32 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:09:32 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 08:09:32 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:09:32 user nova-compute[73091]:       <serial>2c00710f-993d-47dc-b3a1-5f6b2e1ccd59</serial>
Aug 16 08:09:32 user nova-compute[73091]:     </disk>
Aug 16 08:09:32 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:09:32 user nova-compute[73091]:       <mac address="fa:16:3e:ba:e5:eb"/>
Aug 16 08:09:32 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:09:32 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:09:32 user nova-compute[73091]:       <target dev="tapff7593ef-ac"/>
Aug 16 08:09:32 user nova-compute[73091]:     </interface>
Aug 16 08:09:32 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:09:32 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/58fb6a40-f818-4515-be92-9f5dd96e40d6/console.log" append="off"/>
Aug 16 08:09:32 user nova-compute[73091]:     </serial>
Aug 16 08:09:32 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:09:32 user nova-compute[73091]:     <video>
Aug 16 08:09:32 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:09:32 user nova-compute[73091]:     </video>
Aug 16 08:09:32 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:09:32 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:09:32 user nova-compute[73091]:     </rng>
Aug 16 08:09:32 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:09:32 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:09:32 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:09:32 user nova-compute[73091]:     </memballoon>
Aug 16 08:09:32 user nova-compute[73091]:   </devices>
Aug 16 08:09:32 user nova-compute[73091]: </domain>
Aug 16 08:09:32 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-622705224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-622705224',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgwr+lPrpEP5o9ETv2V1lYpdSx5+1jSfz5g40qSuKvSXhEDtmL9vrp71E/TIr7O7WlZ5kcRETw3PrK7xu+z/FUuEGZhJeo4ndVNxGCXeTwKuExSPw6ICDcnszQlQ44bDg==',key_name='tempest-keypair-1739562332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3cd0afcf7cd4d06b6914fd69282e6df',ramdisk_id='',reservation_id='r-j2kcg45t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1659459997',owner_user_name='tempest-ServerActionsV293TestJSON-1659459997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb81b27063f549ab938bea843a3ed7c6',uuid=58fb6a40-f818-4515-be92-9f5dd96e40d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Converting VIF {"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e5:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff7593ef-acd3-4f60-8f85-e4314751d437,network=Network(38194120-0573-40dd-a8f9-78e2afcb9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7593ef-ac') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG os_vif [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e5:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff7593ef-acd3-4f60-8f85-e4314751d437,network=Network(38194120-0573-40dd-a8f9-78e2afcb9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7593ef-ac') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff7593ef-ac, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff7593ef-ac, col_values=(('external_ids', {'iface-id': 'ff7593ef-acd3-4f60-8f85-e4314751d437', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:e5:eb', 'vm-uuid': '58fb6a40-f818-4515-be92-9f5dd96e40d6'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:32 user nova-compute[73091]: INFO os_vif [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e5:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff7593ef-acd3-4f60-8f85-e4314751d437,network=Network(38194120-0573-40dd-a8f9-78e2afcb9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7593ef-ac')
Aug 16 08:09:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:09:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] No VIF found with MAC fa:16:3e:ba:e5:eb, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:09:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-01f1d26e-8271-4909-95e3-8fe0ee130a82 req-14d8e21c-997a-482f-be82-eadeecbe8276 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received event network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-01f1d26e-8271-4909-95e3-8fe0ee130a82 req-14d8e21c-997a-482f-be82-eadeecbe8276 service nova] Acquiring lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-01f1d26e-8271-4909-95e3-8fe0ee130a82 req-14d8e21c-997a-482f-be82-eadeecbe8276 service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-01f1d26e-8271-4909-95e3-8fe0ee130a82 req-14d8e21c-997a-482f-be82-eadeecbe8276 service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-01f1d26e-8271-4909-95e3-8fe0ee130a82 req-14d8e21c-997a-482f-be82-eadeecbe8276 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] No waiting events found dispatching network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:34 user nova-compute[73091]: WARNING nova.compute.manager [req-01f1d26e-8271-4909-95e3-8fe0ee130a82 req-14d8e21c-997a-482f-be82-eadeecbe8276 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received unexpected event network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 for instance with vm_state building and task_state spawning.
Aug 16 08:09:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173376.2383718, 58fb6a40-f818-4515-be92-9f5dd96e40d6 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:09:36 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] VM Resumed (Lifecycle Event)
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:09:36 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Instance spawned successfully.
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:09:36 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173376.2445965, 58fb6a40-f818-4515-be92-9f5dd96e40d6 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:09:36 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] VM Started (Lifecycle Event)
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:09:36 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:09:36 user nova-compute[73091]: INFO nova.compute.manager [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-c7804723-2299-4568-ae68-88fe0533b624 req-d7c16217-bdcd-439f-821f-efe9b16f3cdc service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received event network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c7804723-2299-4568-ae68-88fe0533b624 req-d7c16217-bdcd-439f-821f-efe9b16f3cdc service nova] Acquiring lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c7804723-2299-4568-ae68-88fe0533b624 req-d7c16217-bdcd-439f-821f-efe9b16f3cdc service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c7804723-2299-4568-ae68-88fe0533b624 req-d7c16217-bdcd-439f-821f-efe9b16f3cdc service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-c7804723-2299-4568-ae68-88fe0533b624 req-d7c16217-bdcd-439f-821f-efe9b16f3cdc service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] No waiting events found dispatching network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:09:36 user nova-compute[73091]: WARNING nova.compute.manager [req-c7804723-2299-4568-ae68-88fe0533b624 req-d7c16217-bdcd-439f-821f-efe9b16f3cdc service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received unexpected event network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 for instance with vm_state building and task_state spawning.
Aug 16 08:09:36 user nova-compute[73091]: INFO nova.compute.manager [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Took 22.72 seconds to build instance.
Aug 16 08:09:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5af64ce5-0350-4963-aa95-ad8631a6e2f9 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.881s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:09:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:44 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:09:44 user nova-compute[73091]: INFO nova.compute.claims [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Claim successful on node user
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "5b610a48-4130-48db-91af-0f3926ac775b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.269s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:09:45 user nova-compute[73091]: INFO nova.compute.claims [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Claim successful on node user
Aug 16 08:09:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:09:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:09:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:09:45 user nova-compute[73091]: INFO nova.virt.block_device [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Booting with volume 1f9756d7-906f-48fe-abfa-5b1445639091 at /dev/vda
Aug 16 08:09:45 user nova-compute[73091]: DEBUG nova.policy [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b6aeb7656f3448f9ab9e18953f30432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbad0cbebaa4c47993c46da30699728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG os_brick.utils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cce84f9-89b8-45e8-a540-eb7aeafff95b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e19fc3-6ca8-4753-88e0-289585535793]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[09494784-a598-4fc6-91af-9c5523ca338a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce361c8-1c2b-452f-a3ab-5430f85541f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:09:45 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed168f6-798b-4e5b-93c2-c60fe21fe2e4]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG os_brick.utils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating existing volume attachment record: 98bcdfd6-ae9d-41c8-8c0e-d851cda98d7a {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:09:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:09:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:09:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:09:46 user nova-compute[73091]: INFO nova.virt.block_device [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Booting with volume 369fe995-f701-42e3-92e9-fcbc3c536680 at /dev/vda
Aug 16 08:09:46 user nova-compute[73091]: DEBUG os_brick.utils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3b9ec6-7ebc-4685-92c2-ccb77d3f64e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ea8713-9154-49bf-a0e2-bb4096be6701]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a27514-f128-4156-8635-26970eb81263]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[de485c19-2a04-45ff-8896-b10e53804305]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG nova.policy [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4180033cfe414478a8d71b7eab618f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ab62fd66c14cab96934322638feca6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:09:46 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:09:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5ba72d-7a4b-4349-86b1-7b7d9a24aff2]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG os_brick.utils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating existing volume attachment record: 1abf3851-aff1-4980-bdcc-f3368395f7f4 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:09:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Successfully created port: 81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Successfully created port: 404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Successfully created port: 2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Successfully created port: e28992b9-adef-431a-8323-eff7c955648b {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Successfully created port: 12399afc-df8c-4c43-bf0f-20b6e8d16f12 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Successfully created port: 95c3edd9-641c-4059-9d3f-553918cf9a2e {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:49 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Successfully created port: 55f21c70-3596-4c1f-9688-d1c03967e6c0 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:50 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Successfully created port: b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:51 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Successfully created port: 3016cdef-2342-41d7-af0a-feee127affa8 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Successfully updated port: 81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:09:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-7cba1035-a8c0-4940-9e4a-e34f6c3f7e58 req-9cd01824-647d-400a-a083-495f7532a6d2 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-changed-81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-7cba1035-a8c0-4940-9e4a-e34f6c3f7e58 req-9cd01824-647d-400a-a083-495f7532a6d2 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing instance network info cache due to event network-changed-81da5d0c-cecc-40d5-b7d4-332741f3c96f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:09:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7cba1035-a8c0-4940-9e4a-e34f6c3f7e58 req-9cd01824-647d-400a-a083-495f7532a6d2 service nova] Acquiring lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7cba1035-a8c0-4940-9e4a-e34f6c3f7e58 req-9cd01824-647d-400a-a083-495f7532a6d2 service nova] Acquired lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:52 user nova-compute[73091]: DEBUG nova.network.neutron [req-7cba1035-a8c0-4940-9e4a-e34f6c3f7e58 req-9cd01824-647d-400a-a083-495f7532a6d2 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing network info cache for port 81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:09:52 user nova-compute[73091]: DEBUG nova.network.neutron [req-7cba1035-a8c0-4940-9e4a-e34f6c3f7e58 req-9cd01824-647d-400a-a083-495f7532a6d2 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:09:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Successfully created port: 13190e58-602a-4b42-b35d-c5d977e0cbb9 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:09:53 user nova-compute[73091]: DEBUG nova.network.neutron [req-7cba1035-a8c0-4940-9e4a-e34f6c3f7e58 req-9cd01824-647d-400a-a083-495f7532a6d2 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7cba1035-a8c0-4940-9e4a-e34f6c3f7e58 req-9cd01824-647d-400a-a083-495f7532a6d2 service nova] Releasing lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Successfully updated port: 45f2c112-2fab-4db9-8476-8639488f678a {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:09:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Successfully updated port: 2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:09:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-changed-45f2c112-2fab-4db9-8476-8639488f678a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing instance network info cache due to event network-changed-45f2c112-2fab-4db9-8476-8639488f678a. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:09:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] Acquiring lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] Acquired lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing network info cache for port 45f2c112-2fab-4db9-8476-8639488f678a {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:09:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:09:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] Releasing lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-changed-2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing instance network info cache due to event network-changed-2008915e-4e3b-4433-94c5-b837a4533e72. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:09:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] Acquiring lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] Acquired lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing network info cache for port 2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:09:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:09:55 user nova-compute[73091]: INFO nova.virt.block_device [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Booting with volume b645720c-dcf4-4304-98c8-f3ecb834612f at /dev/vdb
Aug 16 08:09:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG os_brick.utils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b3e0852-bc2b-4b39-b6ed-d84a76dcec7a req-2a73918c-4ffc-4623-8483-2ed6fd931528 service nova] Releasing lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5411dcac-5a35-4583-8a1d-b83714032ea7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[46514ee8-2251-4de8-8e75-50205c3f7378]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6fa352-9f08-4bc4-8438-a19fb1c96dfa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[075bc07b-408e-4f77-95a9-470782bc66b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:09:56 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50ef205-abed-4c79-8913-4009ad5c1013]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG os_brick.utils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating existing volume attachment record: c1ad6537-49b9-4ae7-9977-782bdab3b70d {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Successfully updated port: c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Successfully updated port: 98aea5dd-a8b3-493c-88b7-39b279a71065 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:09:56 user nova-compute[73091]: INFO nova.virt.block_device [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Booting with volume 3c4295bb-295f-4da8-bc40-72722984a3a1 at /dev/vdb
Aug 16 08:09:56 user nova-compute[73091]: DEBUG os_brick.utils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8f75c3-d475-4fec-a3d5-32b717d9f57c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c985ae3-fb8f-48f0-bfbc-db9a05ea99eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0aa229-6ae7-41eb-84e7-4593d045ed02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5380e709-7dd8-41c0-890e-05469d3f5038]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:09:56 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:09:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4412d08-3edc-448a-bc2b-41cf3ea06038]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG os_brick.utils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:09:56 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating existing volume attachment record: 877a45e7-8797-4fc0-8f7c-4f1b876bfc5b {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-changed-c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing instance network info cache due to event network-changed-c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] Acquiring lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] Acquired lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing network info cache for port c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] Releasing lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-changed-98aea5dd-a8b3-493c-88b7-39b279a71065 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing instance network info cache due to event network-changed-98aea5dd-a8b3-493c-88b7-39b279a71065. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] Acquiring lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] Acquired lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing network info cache for port 98aea5dd-a8b3-493c-88b7-39b279a71065 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:09:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:09:58 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Successfully updated port: 404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:09:58 user nova-compute[73091]: DEBUG nova.network.neutron [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-66006058-c42a-4528-a5eb-19b8a69612b4 req-2df9912f-67f0-49dc-812d-3c82ae02a2b1 service nova] Releasing lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:58 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Successfully updated port: 3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:09:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:09:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-changed-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing instance network info cache due to event network-changed-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] Acquiring lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] Acquired lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:58 user nova-compute[73091]: DEBUG nova.network.neutron [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing network info cache for port 404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:09:59 user nova-compute[73091]: DEBUG nova.network.neutron [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:09:59 user nova-compute[73091]: DEBUG nova.network.neutron [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:09:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] Releasing lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:09:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-changed-3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:09:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing instance network info cache due to event network-changed-3c6f6e98-0c46-4f70-b579-6dfb0d9fb684. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:09:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] Acquiring lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:09:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] Acquired lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:09:59 user nova-compute[73091]: DEBUG nova.network.neutron [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing network info cache for port 3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:10:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:10:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3487d246-9a5e-40ab-b1db-baab53aff7cd req-b14b7ada-8ec9-4253-ba00-eefb4bafa5e8 service nova] Releasing lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:01 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Successfully updated port: e28992b9-adef-431a-8323-eff7c955648b {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:10:01 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Successfully updated port: 12399afc-df8c-4c43-bf0f-20b6e8d16f12 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:10:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-9732a413-0e49-418d-9ebf-2cf1e476b88b req-8a1996bd-182d-476a-b25c-ab1a559e469a service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-changed-e28992b9-adef-431a-8323-eff7c955648b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-9732a413-0e49-418d-9ebf-2cf1e476b88b req-8a1996bd-182d-476a-b25c-ab1a559e469a service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing instance network info cache due to event network-changed-e28992b9-adef-431a-8323-eff7c955648b. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:10:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9732a413-0e49-418d-9ebf-2cf1e476b88b req-8a1996bd-182d-476a-b25c-ab1a559e469a service nova] Acquiring lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9732a413-0e49-418d-9ebf-2cf1e476b88b req-8a1996bd-182d-476a-b25c-ab1a559e469a service nova] Acquired lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-9732a413-0e49-418d-9ebf-2cf1e476b88b req-8a1996bd-182d-476a-b25c-ab1a559e469a service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing network info cache for port e28992b9-adef-431a-8323-eff7c955648b {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:10:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-9732a413-0e49-418d-9ebf-2cf1e476b88b req-8a1996bd-182d-476a-b25c-ab1a559e469a service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:10:02 user nova-compute[73091]: DEBUG nova.network.neutron [req-9732a413-0e49-418d-9ebf-2cf1e476b88b req-8a1996bd-182d-476a-b25c-ab1a559e469a service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9732a413-0e49-418d-9ebf-2cf1e476b88b req-8a1996bd-182d-476a-b25c-ab1a559e469a service nova] Releasing lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:03 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Successfully updated port: 95c3edd9-641c-4059-9d3f-553918cf9a2e {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:10:03 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Successfully updated port: 55f21c70-3596-4c1f-9688-d1c03967e6c0 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:10:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-changed-12399afc-df8c-4c43-bf0f-20b6e8d16f12 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing instance network info cache due to event network-changed-12399afc-df8c-4c43-bf0f-20b6e8d16f12. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] Acquiring lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] Acquired lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:03 user nova-compute[73091]: DEBUG nova.network.neutron [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing network info cache for port 12399afc-df8c-4c43-bf0f-20b6e8d16f12 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:10:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:04 user nova-compute[73091]: DEBUG nova.network.neutron [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:10:04 user nova-compute[73091]: DEBUG nova.network.neutron [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] Releasing lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-changed-95c3edd9-641c-4059-9d3f-553918cf9a2e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing instance network info cache due to event network-changed-95c3edd9-641c-4059-9d3f-553918cf9a2e. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:10:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] Acquiring lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] Acquired lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:04 user nova-compute[73091]: DEBUG nova.network.neutron [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing network info cache for port 95c3edd9-641c-4059-9d3f-553918cf9a2e {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:10:04 user nova-compute[73091]: DEBUG nova.network.neutron [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:10:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] Releasing lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-changed-55f21c70-3596-4c1f-9688-d1c03967e6c0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing instance network info cache due to event network-changed-55f21c70-3596-4c1f-9688-d1c03967e6c0. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:10:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] Acquiring lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] Acquired lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing network info cache for port 55f21c70-3596-4c1f-9688-d1c03967e6c0 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:10:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG nova.network.neutron [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Successfully updated port: 3016cdef-2342-41d7-af0a-feee127affa8 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8007f12c-8da0-4453-9d9f-ef0db50fe105 req-e1ce235e-93c6-47fa-85d4-b8f8cc05293c service nova] Releasing lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Successfully updated port: b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquired lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-33d209c8-befa-40a1-bd9a-7c3a1e713d6f req-8736c0fb-9c85-4f84-a7cf-fbcc9a6a1176 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-changed-3016cdef-2342-41d7-af0a-feee127affa8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-33d209c8-befa-40a1-bd9a-7c3a1e713d6f req-8736c0fb-9c85-4f84-a7cf-fbcc9a6a1176 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing instance network info cache due to event network-changed-3016cdef-2342-41d7-af0a-feee127affa8. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-33d209c8-befa-40a1-bd9a-7c3a1e713d6f req-8736c0fb-9c85-4f84-a7cf-fbcc9a6a1176 service nova] Acquiring lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-33d209c8-befa-40a1-bd9a-7c3a1e713d6f req-8736c0fb-9c85-4f84-a7cf-fbcc9a6a1176 service nova] Acquired lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG nova.network.neutron [req-33d209c8-befa-40a1-bd9a-7c3a1e713d6f req-8736c0fb-9c85-4f84-a7cf-fbcc9a6a1176 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing network info cache for port 3016cdef-2342-41d7-af0a-feee127affa8 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG nova.network.neutron [req-33d209c8-befa-40a1-bd9a-7c3a1e713d6f req-8736c0fb-9c85-4f84-a7cf-fbcc9a6a1176 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:10:06 user nova-compute[73091]: INFO nova.virt.block_device [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Booting with volume b2d731c5-4324-4acd-85bf-9e9829071004 at /dev/vdc
Aug 16 08:10:06 user nova-compute[73091]: DEBUG os_brick.utils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2656c0-ae9a-47db-9e57-3d5c2a5be45e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd72c79-f59b-461b-b7d0-61605eb1e984]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82022d9-8f20-4bc3-bd0c-c6a5afb207a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e6a004-54ef-4205-941f-88cea738f09a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:10:07 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f33f17-cf4b-4214-9b68-5798ad53034b]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG os_brick.utils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] <== get_connector_properties: return (242ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating existing volume attachment record: af3cb519-7b92-4bb0-82e2-f84b8cc42bb5 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG nova.network.neutron [req-33d209c8-befa-40a1-bd9a-7c3a1e713d6f req-8736c0fb-9c85-4f84-a7cf-fbcc9a6a1176 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-33d209c8-befa-40a1-bd9a-7c3a1e713d6f req-8736c0fb-9c85-4f84-a7cf-fbcc9a6a1176 service nova] Releasing lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:07 user nova-compute[73091]: INFO nova.virt.block_device [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Booting with volume af07271b-6693-42cb-bee0-00e7417be1bc at /dev/vdc
Aug 16 08:10:07 user nova-compute[73091]: DEBUG os_brick.utils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc5e4af-5e41-441c-af81-f7f45bb09993]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b530bcf-0bd8-44bd-af07-726ff9e4df09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc528d49-41a8-4d3d-95e2-d9c80716f66a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5b844c-cc5b-472f-8904-8b561cbafbf3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:10:07 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:10:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce085fc-06b4-497e-8c98-c5926590f653]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG os_brick.utils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:10:07 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating existing volume attachment record: 178f1450-b353-489f-bcde-b9c8844aa2f0 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:10:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Successfully updated port: 13190e58-602a-4b42-b35d-c5d977e0cbb9 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:10:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquired lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:10:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:10:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-changed-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing instance network info cache due to event network-changed-b2725555-04ce-4049-ad18-6c7164352ea0. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:10:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] Acquiring lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating instance_info_cache with network_info: [{"id": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "address": "fa:16:3e:26:bd:cb", "network": {"id": "1759d93e-5701-4061-b3b6-e192d31f3d94", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-648102261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81da5d0c-ce", "ovs_interfaceid": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "address": "fa:16:3e:0c:14:b8", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404c0ed4-2b", "ovs_interfaceid": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "address": "fa:16:3e:09:f9:0a", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c3edd9-64", "ovs_interfaceid": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2725555-04ce-4049-ad18-6c7164352ea0", "address": "fa:16:3e:7f:c1:00", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2725555-04", "ovs_interfaceid": "b2725555-04ce-4049-ad18-6c7164352ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Releasing lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Instance network_info: |[{"id": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "address": "fa:16:3e:26:bd:cb", "network": {"id": "1759d93e-5701-4061-b3b6-e192d31f3d94", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-648102261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81da5d0c-ce", "ovs_interfaceid": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "address": "fa:16:3e:0c:14:b8", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404c0ed4-2b", "ovs_interfaceid": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "address": "fa:16:3e:09:f9:0a", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c3edd9-64", "ovs_interfaceid": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2725555-04ce-4049-ad18-6c7164352ea0", "address": "fa:16:3e:7f:c1:00", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2725555-04", "ovs_interfaceid": "b2725555-04ce-4049-ad18-6c7164352ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:10:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] Acquired lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing network info cache for port b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:10:11 user nova-compute[73091]: DEBUG nova.network.neutron [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updated VIF entry in instance network info cache for port b2725555-04ce-4049-ad18-6c7164352ea0. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:10:11 user nova-compute[73091]: DEBUG nova.network.neutron [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating instance_info_cache with network_info: [{"id": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "address": "fa:16:3e:26:bd:cb", "network": {"id": "1759d93e-5701-4061-b3b6-e192d31f3d94", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-648102261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81da5d0c-ce", "ovs_interfaceid": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "address": "fa:16:3e:0c:14:b8", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404c0ed4-2b", "ovs_interfaceid": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "address": "fa:16:3e:09:f9:0a", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c3edd9-64", "ovs_interfaceid": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2725555-04ce-4049-ad18-6c7164352ea0", "address": "fa:16:3e:7f:c1:00", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2725555-04", "ovs_interfaceid": "b2725555-04ce-4049-ad18-6c7164352ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] Releasing lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-changed-13190e58-602a-4b42-b35d-c5d977e0cbb9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing instance network info cache due to event network-changed-13190e58-602a-4b42-b35d-c5d977e0cbb9. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] Acquiring lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:11 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating instance_info_cache with network_info: [{"id": "2008915e-4e3b-4433-94c5-b837a4533e72", "address": "fa:16:3e:27:b1:72", "network": {"id": "08557a22-e386-4104-8e71-09e5287b1560", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-735103643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008915e-4e", "ovs_interfaceid": "2008915e-4e3b-4433-94c5-b837a4533e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98aea5dd-a8b3-493c-88b7-39b279a71065", "address": "fa:16:3e:2e:16:79", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aea5dd-a8", "ovs_interfaceid": "98aea5dd-a8b3-493c-88b7-39b279a71065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "address": "fa:16:3e:c1:b6:6b", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6f6e98-0c", "ovs_interfaceid": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "address": "fa:16:3e:98:9d:73", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12399afc-df", "ovs_interfaceid": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "address": "fa:16:3e:97:e5:41", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f21c70-35", "ovs_interfaceid": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3016cdef-2342-41d7-af0a-feee127affa8", "address": "fa:16:3e:3c:0a:32", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3016cdef-23", "ovs_interfaceid": "3016cdef-2342-41d7-af0a-feee127affa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "address": "fa:16:3e:35:54:2d", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13190e58-60", "ovs_interfaceid": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Releasing lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:11 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Instance network_info: |[{"id": "2008915e-4e3b-4433-94c5-b837a4533e72", "address": "fa:16:3e:27:b1:72", "network": {"id": "08557a22-e386-4104-8e71-09e5287b1560", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-735103643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008915e-4e", "ovs_interfaceid": "2008915e-4e3b-4433-94c5-b837a4533e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98aea5dd-a8b3-493c-88b7-39b279a71065", "address": "fa:16:3e:2e:16:79", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aea5dd-a8", "ovs_interfaceid": "98aea5dd-a8b3-493c-88b7-39b279a71065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "address": "fa:16:3e:c1:b6:6b", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6f6e98-0c", "ovs_interfaceid": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "address": "fa:16:3e:98:9d:73", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12399afc-df", "ovs_interfaceid": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "address": "fa:16:3e:97:e5:41", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f21c70-35", "ovs_interfaceid": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3016cdef-2342-41d7-af0a-feee127affa8", "address": "fa:16:3e:3c:0a:32", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3016cdef-23", "ovs_interfaceid": "3016cdef-2342-41d7-af0a-feee127affa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "address": "fa:16:3e:35:54:2d", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13190e58-60", "ovs_interfaceid": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:10:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] Acquired lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:11 user nova-compute[73091]: DEBUG nova.network.neutron [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing network info cache for port 13190e58-602a-4b42-b35d-c5d977e0cbb9 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:10:12 user nova-compute[73091]: DEBUG nova.network.neutron [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updated VIF entry in instance network info cache for port 13190e58-602a-4b42-b35d-c5d977e0cbb9. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:10:12 user nova-compute[73091]: DEBUG nova.network.neutron [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating instance_info_cache with network_info: [{"id": "2008915e-4e3b-4433-94c5-b837a4533e72", "address": "fa:16:3e:27:b1:72", "network": {"id": "08557a22-e386-4104-8e71-09e5287b1560", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-735103643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008915e-4e", "ovs_interfaceid": "2008915e-4e3b-4433-94c5-b837a4533e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98aea5dd-a8b3-493c-88b7-39b279a71065", "address": "fa:16:3e:2e:16:79", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aea5dd-a8", "ovs_interfaceid": "98aea5dd-a8b3-493c-88b7-39b279a71065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "address": "fa:16:3e:c1:b6:6b", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6f6e98-0c", "ovs_interfaceid": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "address": "fa:16:3e:98:9d:73", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12399afc-df", "ovs_interfaceid": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "address": "fa:16:3e:97:e5:41", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f21c70-35", "ovs_interfaceid": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3016cdef-2342-41d7-af0a-feee127affa8", "address": "fa:16:3e:3c:0a:32", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3016cdef-23", "ovs_interfaceid": "3016cdef-2342-41d7-af0a-feee127affa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "address": "fa:16:3e:35:54:2d", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13190e58-60", "ovs_interfaceid": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-935b5367-c3cb-4186-962e-dacaaa573bfb req-04692d1a-6f34-41d6-9d11-6612be7498c5 service nova] Releasing lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:16 user nova-compute[73091]: INFO nova.compute.manager [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Rescuing
Aug 16 08:10:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquired lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:10:16 user nova-compute[73091]: DEBUG nova.network.neutron [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Updating instance_info_cache with network_info: [{"id": "e00351b1-2886-496b-9a27-606de620f78d", "address": "fa:16:3e:13:43:df", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00351b1-28", "ovs_interfaceid": "e00351b1-2886-496b-9a27-606de620f78d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Releasing lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-83adb8ec-3242-44b1-995c-bd469d9fc4e0 req-9c2c4754-4686-4d2f-9297-713b95a67f0f service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Received event network-vif-unplugged-e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-83adb8ec-3242-44b1-995c-bd469d9fc4e0 req-9c2c4754-4686-4d2f-9297-713b95a67f0f service nova] Acquiring lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-83adb8ec-3242-44b1-995c-bd469d9fc4e0 req-9c2c4754-4686-4d2f-9297-713b95a67f0f service nova] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-83adb8ec-3242-44b1-995c-bd469d9fc4e0 req-9c2c4754-4686-4d2f-9297-713b95a67f0f service nova] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-83adb8ec-3242-44b1-995c-bd469d9fc4e0 req-9c2c4754-4686-4d2f-9297-713b95a67f0f service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] No waiting events found dispatching network-vif-unplugged-e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:17 user nova-compute[73091]: WARNING nova.compute.manager [req-83adb8ec-3242-44b1-995c-bd469d9fc4e0 req-9c2c4754-4686-4d2f-9297-713b95a67f0f service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Received unexpected event network-vif-unplugged-e00351b1-2886-496b-9a27-606de620f78d for instance with vm_state active and task_state rescuing.
Aug 16 08:10:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:10:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Creating image(s)
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Ensure instance console log exists: /opt/stack/data/nova/instances/bac3dbae-0134-450c-9220-0dd96e74aef0/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Start _get_guest_xml network_info=[{"id": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "address": "fa:16:3e:26:bd:cb", "network": {"id": "1759d93e-5701-4061-b3b6-e192d31f3d94", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-648102261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81da5d0c-ce", "ovs_interfaceid": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "address": "fa:16:3e:0c:14:b8", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404c0ed4-2b", "ovs_interfaceid": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "address": "fa:16:3e:09:f9:0a", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c3edd9-64", "ovs_interfaceid": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2725555-04ce-4049-ad18-6c7164352ea0", "address": "fa:16:3e:7f:c1:00", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2725555-04", "ovs_interfaceid": "b2725555-04ce-4049-ad18-6c7164352ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '98bcdfd6-ae9d-41c8-8c0e-d851cda98d7a', 'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJnsbEul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bac3dbae-0134-450c-9220-0dd96e74aef0', 'attached_at': '', 'detached_at': '', 'volume_id': '1f9756d7-906f-48fe-abfa-5b1445639091', 'serial': '1f9756d7-906f-48fe-abfa-5b1445639091'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'attachment_id': 'c1ad6537-49b9-4ae7-9977-782bdab3b70d', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsRcZlim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bac3dbae-0134-450c-9220-0dd96e74aef0', 'attached_at': '', 'detached_at': '', 'volume_id': 'b645720c-dcf4-4304-98c8-f3ecb834612f', 'serial': 'b645720c-dcf4-4304-98c8-f3ecb834612f'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'attachment_id': 'af3cb519-7b92-4bb0-82e2-f84b8cc42bb5', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmDueGSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bac3dbae-0134-450c-9220-0dd96e74aef0', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2d731c5-4324-4acd-85bf-9e9829071004', 'serial': 'b2d731c5-4324-4acd-85bf-9e9829071004'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:10:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Instance destroyed successfully.
Aug 16 08:10:17 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:10:17 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:10:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Attempting rescue
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJnsbEul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:10:17 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:10:17 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:10:17 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 08:10:17 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Creating image(s)
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "/opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "/opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.078s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4a6248b9-f577-4efd-baa2-eb5eb3e47495 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa53e7c-c82a-4b02-bef5-085f9946f36d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:10:17 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2708ec4c-66ee-4e03-82db-084e2b356d66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091] added
Aug 16 08:10:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b02a044-e699-4b50-9ea4-b7844965578c]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb0d0b1-2069-4c5b-91fe-a81727a0b448]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJnsbEul {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJnsbEul" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2358a60e-9fb2-407d-9337-41db91b0e133]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gJnsbEul'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e90475b-66c6-4b96-9c3a-4564d58c456a]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd850196-bf48-4349-9d25-25f586ba5394]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:10:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:10:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Creating image(s)
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Ensure instance console log exists: /opt/stack/data/nova/instances/5b610a48-4130-48db-91af-0f3926ac775b/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Start _get_guest_xml network_info=[{"id": "2008915e-4e3b-4433-94c5-b837a4533e72", "address": "fa:16:3e:27:b1:72", "network": {"id": "08557a22-e386-4104-8e71-09e5287b1560", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-735103643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008915e-4e", "ovs_interfaceid": "2008915e-4e3b-4433-94c5-b837a4533e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98aea5dd-a8b3-493c-88b7-39b279a71065", "address": "fa:16:3e:2e:16:79", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aea5dd-a8", "ovs_interfaceid": "98aea5dd-a8b3-493c-88b7-39b279a71065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "address": "fa:16:3e:c1:b6:6b", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6f6e98-0c", "ovs_interfaceid": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "address": "fa:16:3e:98:9d:73", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12399afc-df", "ovs_interfaceid": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "address": "fa:16:3e:97:e5:41", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f21c70-35", "ovs_interfaceid": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3016cdef-2342-41d7-af0a-feee127affa8", "address": "fa:16:3e:3c:0a:32", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3016cdef-23", "ovs_interfaceid": "3016cdef-2342-41d7-af0a-feee127affa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "address": "fa:16:3e:35:54:2d", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13190e58-60", "ovs_interfaceid": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '1abf3851-aff1-4980-bdcc-f3368395f7f4', 'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krOtefGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b610a48-4130-48db-91af-0f3926ac775b', 'attached_at': '', 'detached_at': '', 'volume_id': '369fe995-f701-42e3-92e9-fcbc3c536680', 'serial': '369fe995-f701-42e3-92e9-fcbc3c536680'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'attachment_id': '877a45e7-8797-4fc0-8f7c-4f1b876bfc5b', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYziSaWI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b610a48-4130-48db-91af-0f3926ac775b', 'attached_at': '', 'detached_at': '', 'volume_id': '3c4295bb-295f-4da8-bc40-72722984a3a1', 'serial': '3c4295bb-295f-4da8-bc40-72722984a3a1'}, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'attachment_id': '178f1450-b353-489f-bcde-b9c8844aa2f0', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KkiIdfsY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b610a48-4130-48db-91af-0f3926ac775b', 'attached_at': '', 'detached_at': '', 'volume_id': 'af07271b-6693-42cb-bee0-00e7417be1bc', 'serial': 'af07271b-6693-42cb-bee0-00e7417be1bc'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9225279-85f5-4780-8d6d-7f30e79ac813]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091, portal: 172.16.0.220,3260]
Aug 16 08:10:18 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091, portal: 172.16.0.220,3260] successful.
Aug 16 08:10:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:10:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue" returned: 0 in 0.054s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'migration_context' on Instance uuid 4a6248b9-f577-4efd-baa2-eb5eb3e47495 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krOtefGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:10:18 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e560485e-ec8a-4fdd-9e80-60ee2b2c58e0]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Start _get_guest_xml network_info=[{"id": "e00351b1-2886-496b-9a27-606de620f78d", "address": "fa:16:3e:13:43:df", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "vif_mac": "fa:16:3e:13:43:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00351b1-28", "ovs_interfaceid": "e00351b1-2886-496b-9a27-606de620f78d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'resources' on Instance uuid 4a6248b9-f577-4efd-baa2-eb5eb3e47495 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a6248b9-f577-4efd-baa2-eb5eb3e47495 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aa5c8d-2d25-45a9-b86f-91fefe18500c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:18 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:18 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:18 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.443s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:10:18 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4a6248b9-f577-4efd-baa2-eb5eb3e47495 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[734081f5-92d6-45be-b62a-c2c74003a243]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJnsbEul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1432471970',display_name='tempest-ServerRescueNegativeTestJSON-server-1432471970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1432471970',id=2,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:08:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='417ed7a5d52f4f7eaa4b6328864808ea',ramdisk_id='',reservation_id='r-4o0tk1mr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1374385894',owner_user_name='tempest-ServerRescueNegativeTestJSON-1374385894-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:08:45Z,user_data=None,user_id='7a24330919014a2985e7926747cbbcdc',uuid=4a6248b9-f577-4efd-baa2-eb5eb3e47495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e00351b1-2886-496b-9a27-606de620f78d", "address": "fa:16:3e:13:43:df", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "vif_mac": "fa:16:3e:13:43:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00351b1-28", "ovs_interfaceid": "e00351b1-2886-496b-9a27-606de620f78d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converting VIF {"id": "e00351b1-2886-496b-9a27-606de620f78d", "address": "fa:16:3e:13:43:df", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "vif_mac": "fa:16:3e:13:43:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00351b1-28", "ovs_interfaceid": "e00351b1-2886-496b-9a27-606de620f78d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:43:df,bridge_name='br-int',has_traffic_filtering=True,id=e00351b1-2886-496b-9a27-606de620f78d,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape00351b1-28') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a6248b9-f577-4efd-baa2-eb5eb3e47495 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:10:18 user nova-compute[73091]:   <uuid>4a6248b9-f577-4efd-baa2-eb5eb3e47495</uuid>
Aug 16 08:10:18 user nova-compute[73091]:   <name>instance-00000002</name>
Aug 16 08:10:18 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:10:18 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:10:18 user nova-compute[73091]:   <metadata>
Aug 16 08:10:18 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:10:18 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:10:18 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1432471970</nova:name>
Aug 16 08:10:18 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:10:18</nova:creationTime>
Aug 16 08:10:18 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:10:18 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:10:18 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:10:18 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:10:18 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:10:18 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:10:18 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:10:18 user nova-compute[73091]:       <nova:owner>
Aug 16 08:10:18 user nova-compute[73091]:         <nova:user uuid="7a24330919014a2985e7926747cbbcdc">tempest-ServerRescueNegativeTestJSON-1374385894-project-member</nova:user>
Aug 16 08:10:18 user nova-compute[73091]:         <nova:project uuid="417ed7a5d52f4f7eaa4b6328864808ea">tempest-ServerRescueNegativeTestJSON-1374385894</nova:project>
Aug 16 08:10:18 user nova-compute[73091]:       </nova:owner>
Aug 16 08:10:18 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:10:18 user nova-compute[73091]:       <nova:ports>
Aug 16 08:10:18 user nova-compute[73091]:         <nova:port uuid="e00351b1-2886-496b-9a27-606de620f78d">
Aug 16 08:10:18 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 08:10:18 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:18 user nova-compute[73091]:       </nova:ports>
Aug 16 08:10:18 user nova-compute[73091]:     </nova:instance>
Aug 16 08:10:18 user nova-compute[73091]:   </metadata>
Aug 16 08:10:18 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:10:18 user nova-compute[73091]:     <system>
Aug 16 08:10:18 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:10:18 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:10:18 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:10:18 user nova-compute[73091]:       <entry name="serial">4a6248b9-f577-4efd-baa2-eb5eb3e47495</entry>
Aug 16 08:10:18 user nova-compute[73091]:       <entry name="uuid">4a6248b9-f577-4efd-baa2-eb5eb3e47495</entry>
Aug 16 08:10:18 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:10:18 user nova-compute[73091]:     </system>
Aug 16 08:10:18 user nova-compute[73091]:   </sysinfo>
Aug 16 08:10:18 user nova-compute[73091]:   <os>
Aug 16 08:10:18 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:10:18 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:10:18 user nova-compute[73091]:   </os>
Aug 16 08:10:18 user nova-compute[73091]:   <features>
Aug 16 08:10:18 user nova-compute[73091]:     <acpi/>
Aug 16 08:10:18 user nova-compute[73091]:     <apic/>
Aug 16 08:10:18 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:10:18 user nova-compute[73091]:   </features>
Aug 16 08:10:18 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:10:18 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:10:18 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:10:18 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:10:18 user nova-compute[73091]:   </clock>
Aug 16 08:10:18 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:10:18 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:10:18 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:10:18 user nova-compute[73091]:   </cpu>
Aug 16 08:10:18 user nova-compute[73091]:   <devices>
Aug 16 08:10:18 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:10:18 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:10:18 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue"/>
Aug 16 08:10:18 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:10:18 user nova-compute[73091]:     </disk>
Aug 16 08:10:18 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:10:18 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:10:18 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk"/>
Aug 16 08:10:18 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 08:10:18 user nova-compute[73091]:     </disk>
Aug 16 08:10:18 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:18 user nova-compute[73091]:       <mac address="fa:16:3e:13:43:df"/>
Aug 16 08:10:18 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:18 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:18 user nova-compute[73091]:       <target dev="tape00351b1-28"/>
Aug 16 08:10:18 user nova-compute[73091]:     </interface>
Aug 16 08:10:18 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:10:18 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/console.log" append="off"/>
Aug 16 08:10:18 user nova-compute[73091]:     </serial>
Aug 16 08:10:18 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:10:18 user nova-compute[73091]:     <video>
Aug 16 08:10:18 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:18 user nova-compute[73091]:     </video>
Aug 16 08:10:18 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:10:18 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:10:18 user nova-compute[73091]:     </rng>
Aug 16 08:10:18 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:10:18 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:10:18 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:10:18 user nova-compute[73091]:     </memballoon>
Aug 16 08:10:18 user nova-compute[73091]:   </devices>
Aug 16 08:10:18 user nova-compute[73091]: </domain>
Aug 16 08:10:18 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:10:18 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Instance destroyed successfully.
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:10:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No VIF found with MAC fa:16:3e:13:43:df, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] <== connect_volume: return (1489ms) {'type': 'block', 'scsi_wwn': '23531623961373134', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531623961373134', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.070s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:10:19 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:10:19 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fac83e-fa4f-4124-8d12-c7567fc77356]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:10:19 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsRcZlim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:10:19 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f30fffd-5dca-4372-b400-16ba10bf0636]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680] added
Aug 16 08:10:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe246af-8ed3-4112-8f12-b6d56426f7c7]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[144efbcd-bd2d-45b6-a83c-a5fa2414dc3a]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v krOtefGH {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v krOtefGH" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e8d361-90b4-4b34-b1ac-280e4c9e47db]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'krOtefGH'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaad088-8b6e-404f-8c54-7cea7cba56da]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9e934d-64b9-427e-bdf8-f305d0d87267]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:19 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:19 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-88251d3e-988c-49a9-8c06-f000611b23d5 req-aaebbd2d-840f-417b-bf8f-f595624e4d0b service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Received event network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-88251d3e-988c-49a9-8c06-f000611b23d5 req-aaebbd2d-840f-417b-bf8f-f595624e4d0b service nova] Acquiring lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-88251d3e-988c-49a9-8c06-f000611b23d5 req-aaebbd2d-840f-417b-bf8f-f595624e4d0b service nova] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-88251d3e-988c-49a9-8c06-f000611b23d5 req-aaebbd2d-840f-417b-bf8f-f595624e4d0b service nova] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-88251d3e-988c-49a9-8c06-f000611b23d5 req-aaebbd2d-840f-417b-bf8f-f595624e4d0b service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] No waiting events found dispatching network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:19 user nova-compute[73091]: WARNING nova.compute.manager [req-88251d3e-988c-49a9-8c06-f000611b23d5 req-aaebbd2d-840f-417b-bf8f-f595624e4d0b service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Received unexpected event network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d for instance with vm_state active and task_state rescuing.
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[be91b64c-e216-4119-a393-d522e353e524]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680, portal: 172.16.0.220,3260]
Aug 16 08:10:19 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680, portal: 172.16.0.220,3260] successful.
Aug 16 08:10:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fa856d-54bc-4dd4-acd5-f021bf42f275]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d142c093-71c0-426e-a97d-69b793d4f173]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:19 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:19 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:19 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:19 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb29c4a-e8f3-464c-b9e7-a37311d80ad4]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krOtefGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] <== connect_volume: return (2376ms) {'type': 'block', 'scsi_wwn': '23130653537623639', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130653537623639', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.281s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:10:20 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:10:20 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[89884d1b-8a53-437b-9d98-f34cccb826b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:10:20 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYziSaWI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:10:20 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[31441ac0-a381-4737-b61f-019938b47d71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f] added
Aug 16 08:10:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[800e8f70-080f-478a-8ffb-3d88f3543f01]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1d4681-fe55-48ab-8c11-254b492850a9]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tsRcZlim {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tsRcZlim" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c8fdff-2497-4d91-a94d-543410bccf51]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tsRcZlim'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[14943f3b-8d36-4d1a-a3cc-0c184bb1de06]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8427011-7ce8-4309-bd8d-89b190410ad4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:20 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:20 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:20 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:20 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb469cd-812c-4bab-8ab5-23c5910d51b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f, portal: 172.16.0.220,3260]
Aug 16 08:10:20 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f, portal: 172.16.0.220,3260] successful.
Aug 16 08:10:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2b967d-fa40-4eb8-a01d-8c70c3865510]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b21ba2-8d03-4201-beee-558b18ee59a2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:20 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:20 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:20 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:10:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:20 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:20 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:20 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:10:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f727472-47f2-4ea3-a7d3-88c4b4ce8674]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsRcZlim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.364s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-7863dccb-a864-49be-8de0-5cb7988d48f0 req-fea3f08d-709a-46d8-bf14-15a605607e60 service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Received event network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7863dccb-a864-49be-8de0-5cb7988d48f0 req-fea3f08d-709a-46d8-bf14-15a605607e60 service nova] Acquiring lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7863dccb-a864-49be-8de0-5cb7988d48f0 req-fea3f08d-709a-46d8-bf14-15a605607e60 service nova] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7863dccb-a864-49be-8de0-5cb7988d48f0 req-fea3f08d-709a-46d8-bf14-15a605607e60 service nova] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-7863dccb-a864-49be-8de0-5cb7988d48f0 req-fea3f08d-709a-46d8-bf14-15a605607e60 service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] No waiting events found dispatching network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:21 user nova-compute[73091]: WARNING nova.compute.manager [req-7863dccb-a864-49be-8de0-5cb7988d48f0 req-fea3f08d-709a-46d8-bf14-15a605607e60 service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Received unexpected event network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d for instance with vm_state active and task_state rescuing.
Aug 16 08:10:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-7863dccb-a864-49be-8de0-5cb7988d48f0 req-fea3f08d-709a-46d8-bf14-15a605607e60 service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Received event network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7863dccb-a864-49be-8de0-5cb7988d48f0 req-fea3f08d-709a-46d8-bf14-15a605607e60 service nova] Acquiring lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7863dccb-a864-49be-8de0-5cb7988d48f0 req-fea3f08d-709a-46d8-bf14-15a605607e60 service nova] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7863dccb-a864-49be-8de0-5cb7988d48f0 req-fea3f08d-709a-46d8-bf14-15a605607e60 service nova] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-7863dccb-a864-49be-8de0-5cb7988d48f0 req-fea3f08d-709a-46d8-bf14-15a605607e60 service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] No waiting events found dispatching network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:21 user nova-compute[73091]: WARNING nova.compute.manager [req-7863dccb-a864-49be-8de0-5cb7988d48f0 req-fea3f08d-709a-46d8-bf14-15a605607e60 service nova] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Received unexpected event network-vif-plugged-e00351b1-2886-496b-9a27-606de620f78d for instance with vm_state active and task_state rescuing.
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] <== connect_volume: return (2658ms) {'type': 'block', 'scsi_wwn': '23833393162346537', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833393162346537', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.346s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:10:21 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:10:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:10:21 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0f1bdc-0fb6-4ab5-bc58-b128c4052393]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:10:21 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmDueGSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:10:21 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:10:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6715ea6f-ff69-48fb-9240-06bd9b6c5ab9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1] added
Aug 16 08:10:21 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b95e749-0a7a-4bc2-b117-47c24fa4a914]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[675e3016-5829-449a-8006-199052dd25fc]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TYziSaWI {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Removed pending event for 4a6248b9-f577-4efd-baa2-eb5eb3e47495 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173422.033443, 4a6248b9-f577-4efd-baa2-eb5eb3e47495 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:10:22 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] VM Resumed (Lifecycle Event)
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TYziSaWI" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaecd18d-b445-4067-9354-b382d6520453]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TYziSaWI'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f31e6ccb-0bca-4579-95be-ff09faf4e08c tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd586185-ba7a-4a40-be0f-ffb5c4d13d97]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[184ab590-3aef-4e71-9880-253de2cd1186]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:22 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:22 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:22 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:10:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:22 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:22 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:22 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:10:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:22 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 08:10:22 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173422.0364244, 4a6248b9-f577-4efd-baa2-eb5eb3e47495 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:10:22 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] VM Started (Lifecycle Event)
Aug 16 08:10:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f955d1e6-ec93-433a-bf13-084b07454e04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1, portal: 172.16.0.220,3260]
Aug 16 08:10:22 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1, portal: 172.16.0.220,3260] successful.
Aug 16 08:10:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15bc586-d370-4c51-b1c7-a17482edc76f]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe382ef8-29bd-4cab-ac8a-1174b6ec9add]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:22 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:22 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:22 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:10:22 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:10:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:22 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:22 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:22 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:10:22 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:10:22 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9a93d3-f117-4372-a94c-19ca511d2ba1]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYziSaWI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG nova.compute.manager [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:22 user nova-compute[73091]: INFO nova.compute.manager [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] instance snapshotting
Aug 16 08:10:22 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Beginning live snapshot process
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] <== connect_volume: return (2806ms) {'type': 'block', 'scsi_wwn': '23030643237356630', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030643237356630', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.423s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:10:23 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:10:23 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf3f7fc-0041-41d3-b4b1-867700145ae1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:10:23 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0474d0a-cbc2-4bc7-9e5c-5d447af5b3fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004] added
Aug 16 08:10:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KkiIdfsY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:10:23 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b345595-b862-4f5c-b42e-97acf9da33f7]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a712b1-3537-45aa-a047-5afa071b450a]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmDueGSU {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmDueGSU" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a888e5-a7c5-4d46-9471-e7be399d939c]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NmDueGSU'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[af138055-a9a8-4224-b4a6-9737860a35e4]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10cefc4-2b79-4d17-ae6e-4560538d8ec1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.224s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxgdsd9a1/dc354e7ada314b0089274bccd8077bac.delta 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxgdsd9a1/dc354e7ada314b0089274bccd8077bac.delta 1073741824" returned: 0 in 0.050s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 08:10:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73091) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 16 08:10:23 user nova-compute[73091]: INFO nova.virt.libvirt.host [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] UEFI support detected
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9cc9cf-c6f7-4ec6-ab25-78fb8c693402]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004, portal: 172.16.0.220,3260]
Aug 16 08:10:23 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004, portal: 172.16.0.220,3260] successful.
Aug 16 08:10:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b436d1fa-bbc4-465e-bcc2-2997d50a2a82]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f50711a-3e03-497c-9c40-f37925ba7f9b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:10:23 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[923dbeb7-d39c-4ab2-8eaa-462e5a27a659]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmDueGSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] <== connect_volume: return (2860ms) {'type': 'block', 'scsi_wwn': '23039616136393061', 'path': '/dev/sdg'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039616136393061', 'path': '/dev/sdg'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.367s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:10:24 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:10:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:10:24 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d230920e-d586-4be9-be68-bf014f61a064]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:10:24 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.059s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cc1d84-b179-4d47-b6bd-a55ca6a8b5e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc] added
Aug 16 08:10:24 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "address": "fa:16:3e:26:bd:cb", "network": {"id": "1759d93e-5701-4061-b3b6-e192d31f3d94", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-648102261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81da5d0c-ce", "ovs_interfaceid": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "address": "fa:16:3e:26:bd:cb", "network": {"id": "1759d93e-5701-4061-b3b6-e192d31f3d94", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-648102261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81da5d0c-ce", "ovs_interfaceid": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:bd:cb,bridge_name='br-int',has_traffic_filtering=True,id=81da5d0c-cecc-40d5-b7d4-332741f3c96f,network=Network(1759d93e-5701-4061-b3b6-e192d31f3d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81da5d0c-ce') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:96:78,bridge_name='br-int',has_traffic_filtering=True,id=45f2c112-2fab-4db9-8476-8639488f678a,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45f2c112-2f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:71:2d,bridge_name='br-int',has_traffic_filtering=True,id=c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6ed638e-4f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "address": "fa:16:3e:0c:14:b8", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404c0ed4-2b", "ovs_interfaceid": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "address": "fa:16:3e:0c:14:b8", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404c0ed4-2b", "ovs_interfaceid": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=404c0ed4-2bc5-4608-8a0e-4f71a08c7b74,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404c0ed4-2b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:28:16,bridge_name='br-int',has_traffic_filtering=True,id=e28992b9-adef-431a-8323-eff7c955648b,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28992b9-ad') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "address": "fa:16:3e:09:f9:0a", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c3edd9-64", "ovs_interfaceid": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "address": "fa:16:3e:09:f9:0a", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c3edd9-64", "ovs_interfaceid": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=95c3edd9-641c-4059-9d3f-553918cf9a2e,network=Network(91679214-2ee2-419f-8daf-b712380c2fb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c3edd9-64') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2725555-04ce-4049-ad18-6c7164352ea0", "address": "fa:16:3e:7f:c1:00", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2725555-04", "ovs_interfaceid": "b2725555-04ce-4049-ad18-6c7164352ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "b2725555-04ce-4049-ad18-6c7164352ea0", "address": "fa:16:3e:7f:c1:00", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2725555-04", "ovs_interfaceid": "b2725555-04ce-4049-ad18-6c7164352ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c1:00,bridge_name='br-int',has_traffic_filtering=True,id=b2725555-04ce-4049-ad18-6c7164352ea0,network=Network(91679214-2ee2-419f-8daf-b712380c2fb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2725555-04') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG nova.objects.instance [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lazy-loading 'pci_devices' on Instance uuid bac3dbae-0134-450c-9220-0dd96e74aef0 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:24 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5373055-2a61-40e5-af87-f07bbe784a89]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:10:25 user nova-compute[73091]:   <uuid>bac3dbae-0134-450c-9220-0dd96e74aef0</uuid>
Aug 16 08:10:25 user nova-compute[73091]:   <name>instance-0000000b</name>
Aug 16 08:10:25 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:10:25 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:10:25 user nova-compute[73091]:   <metadata>
Aug 16 08:10:25 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:10:25 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:10:25 user nova-compute[73091]:       <nova:name>tempest-device-tagging-server-452584988</nova:name>
Aug 16 08:10:25 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:10:17</nova:creationTime>
Aug 16 08:10:25 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:10:25 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:10:25 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:10:25 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:10:25 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:10:25 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:10:25 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:10:25 user nova-compute[73091]:       <nova:owner>
Aug 16 08:10:25 user nova-compute[73091]:         <nova:user uuid="3b6aeb7656f3448f9ab9e18953f30432">tempest-TaggedBootDevicesTest_v242-1352082067-project-member</nova:user>
Aug 16 08:10:25 user nova-compute[73091]:         <nova:project uuid="6cbad0cbebaa4c47993c46da30699728">tempest-TaggedBootDevicesTest_v242-1352082067</nova:project>
Aug 16 08:10:25 user nova-compute[73091]:       </nova:owner>
Aug 16 08:10:25 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:10:25 user nova-compute[73091]:       <nova:ports>
Aug 16 08:10:25 user nova-compute[73091]:         <nova:port uuid="81da5d0c-cecc-40d5-b7d4-332741f3c96f">
Aug 16 08:10:25 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 08:10:25 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:25 user nova-compute[73091]:         <nova:port uuid="45f2c112-2fab-4db9-8476-8639488f678a">
Aug 16 08:10:25 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.87" ipVersion="4"/>
Aug 16 08:10:25 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:25 user nova-compute[73091]:         <nova:port uuid="c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8">
Aug 16 08:10:25 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.155" ipVersion="4"/>
Aug 16 08:10:25 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:25 user nova-compute[73091]:         <nova:port uuid="404c0ed4-2bc5-4608-8a0e-4f71a08c7b74">
Aug 16 08:10:25 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.5" ipVersion="4"/>
Aug 16 08:10:25 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:25 user nova-compute[73091]:         <nova:port uuid="e28992b9-adef-431a-8323-eff7c955648b">
Aug 16 08:10:25 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.156" ipVersion="4"/>
Aug 16 08:10:25 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:25 user nova-compute[73091]:         <nova:port uuid="95c3edd9-641c-4059-9d3f-553918cf9a2e">
Aug 16 08:10:25 user nova-compute[73091]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 08:10:25 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:25 user nova-compute[73091]:         <nova:port uuid="b2725555-04ce-4049-ad18-6c7164352ea0">
Aug 16 08:10:25 user nova-compute[73091]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 08:10:25 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:25 user nova-compute[73091]:       </nova:ports>
Aug 16 08:10:25 user nova-compute[73091]:     </nova:instance>
Aug 16 08:10:25 user nova-compute[73091]:   </metadata>
Aug 16 08:10:25 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:10:25 user nova-compute[73091]:     <system>
Aug 16 08:10:25 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:10:25 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:10:25 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:10:25 user nova-compute[73091]:       <entry name="serial">bac3dbae-0134-450c-9220-0dd96e74aef0</entry>
Aug 16 08:10:25 user nova-compute[73091]:       <entry name="uuid">bac3dbae-0134-450c-9220-0dd96e74aef0</entry>
Aug 16 08:10:25 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:10:25 user nova-compute[73091]:     </system>
Aug 16 08:10:25 user nova-compute[73091]:   </sysinfo>
Aug 16 08:10:25 user nova-compute[73091]:   <os>
Aug 16 08:10:25 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:10:25 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:10:25 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:10:25 user nova-compute[73091]:   </os>
Aug 16 08:10:25 user nova-compute[73091]:   <features>
Aug 16 08:10:25 user nova-compute[73091]:     <acpi/>
Aug 16 08:10:25 user nova-compute[73091]:     <apic/>
Aug 16 08:10:25 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:10:25 user nova-compute[73091]:   </features>
Aug 16 08:10:25 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:10:25 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:10:25 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:10:25 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:10:25 user nova-compute[73091]:   </clock>
Aug 16 08:10:25 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:10:25 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:10:25 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:10:25 user nova-compute[73091]:   </cpu>
Aug 16 08:10:25 user nova-compute[73091]:   <devices>
Aug 16 08:10:25 user nova-compute[73091]:     <disk type="file" device="cdrom">
Aug 16 08:10:25 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 08:10:25 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/bac3dbae-0134-450c-9220-0dd96e74aef0/disk.config"/>
Aug 16 08:10:25 user nova-compute[73091]:       <target dev="hda" bus="ide"/>
Aug 16 08:10:25 user nova-compute[73091]:     </disk>
Aug 16 08:10:25 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:10:25 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:10:25 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 16 08:10:25 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:10:25 user nova-compute[73091]:       <serial>1f9756d7-906f-48fe-abfa-5b1445639091</serial>
Aug 16 08:10:25 user nova-compute[73091]:     </disk>
Aug 16 08:10:25 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:10:25 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:10:25 user nova-compute[73091]:       <source dev="/dev/sde"/>
Aug 16 08:10:25 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 08:10:25 user nova-compute[73091]:       <serial>b645720c-dcf4-4304-98c8-f3ecb834612f</serial>
Aug 16 08:10:25 user nova-compute[73091]:     </disk>
Aug 16 08:10:25 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:10:25 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:10:25 user nova-compute[73091]:       <source dev="/dev/sdg"/>
Aug 16 08:10:25 user nova-compute[73091]:       <target dev="vdc" bus="virtio"/>
Aug 16 08:10:25 user nova-compute[73091]:       <serial>b2d731c5-4324-4acd-85bf-9e9829071004</serial>
Aug 16 08:10:25 user nova-compute[73091]:     </disk>
Aug 16 08:10:25 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:25 user nova-compute[73091]:       <mac address="fa:16:3e:26:bd:cb"/>
Aug 16 08:10:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:25 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:25 user nova-compute[73091]:       <target dev="tap81da5d0c-ce"/>
Aug 16 08:10:25 user nova-compute[73091]:     </interface>
Aug 16 08:10:25 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:25 user nova-compute[73091]:       <mac address="fa:16:3e:27:96:78"/>
Aug 16 08:10:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:25 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:25 user nova-compute[73091]:       <target dev="tap45f2c112-2f"/>
Aug 16 08:10:25 user nova-compute[73091]:     </interface>
Aug 16 08:10:25 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:25 user nova-compute[73091]:       <mac address="fa:16:3e:57:71:2d"/>
Aug 16 08:10:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:25 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:25 user nova-compute[73091]:       <target dev="tapc6ed638e-4f"/>
Aug 16 08:10:25 user nova-compute[73091]:     </interface>
Aug 16 08:10:25 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:25 user nova-compute[73091]:       <mac address="fa:16:3e:0c:14:b8"/>
Aug 16 08:10:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:25 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:25 user nova-compute[73091]:       <target dev="tap404c0ed4-2b"/>
Aug 16 08:10:25 user nova-compute[73091]:     </interface>
Aug 16 08:10:25 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:25 user nova-compute[73091]:       <mac address="fa:16:3e:0d:28:16"/>
Aug 16 08:10:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:25 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:25 user nova-compute[73091]:       <target dev="tape28992b9-ad"/>
Aug 16 08:10:25 user nova-compute[73091]:     </interface>
Aug 16 08:10:25 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:25 user nova-compute[73091]:       <mac address="fa:16:3e:09:f9:0a"/>
Aug 16 08:10:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:25 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:25 user nova-compute[73091]:       <target dev="tap95c3edd9-64"/>
Aug 16 08:10:25 user nova-compute[73091]:     </interface>
Aug 16 08:10:25 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:25 user nova-compute[73091]:       <mac address="fa:16:3e:7f:c1:00"/>
Aug 16 08:10:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:25 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:25 user nova-compute[73091]:       <target dev="tapb2725555-04"/>
Aug 16 08:10:25 user nova-compute[73091]:     </interface>
Aug 16 08:10:25 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:10:25 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/bac3dbae-0134-450c-9220-0dd96e74aef0/console.log" append="off"/>
Aug 16 08:10:25 user nova-compute[73091]:     </serial>
Aug 16 08:10:25 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:10:25 user nova-compute[73091]:     <video>
Aug 16 08:10:25 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:25 user nova-compute[73091]:     </video>
Aug 16 08:10:25 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:10:25 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:10:25 user nova-compute[73091]:     </rng>
Aug 16 08:10:25 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:10:25 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:10:25 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:10:25 user nova-compute[73091]:     </memballoon>
Aug 16 08:10:25 user nova-compute[73091]:   </devices>
Aug 16 08:10:25 user nova-compute[73091]: </domain>
Aug 16 08:10:25 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "address": "fa:16:3e:26:bd:cb", "network": {"id": "1759d93e-5701-4061-b3b6-e192d31f3d94", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-648102261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81da5d0c-ce", "ovs_interfaceid": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "address": "fa:16:3e:26:bd:cb", "network": {"id": "1759d93e-5701-4061-b3b6-e192d31f3d94", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-648102261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81da5d0c-ce", "ovs_interfaceid": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:bd:cb,bridge_name='br-int',has_traffic_filtering=True,id=81da5d0c-cecc-40d5-b7d4-332741f3c96f,network=Network(1759d93e-5701-4061-b3b6-e192d31f3d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81da5d0c-ce') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:bd:cb,bridge_name='br-int',has_traffic_filtering=True,id=81da5d0c-cecc-40d5-b7d4-332741f3c96f,network=Network(1759d93e-5701-4061-b3b6-e192d31f3d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81da5d0c-ce') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3d0fbb-4f87-4ab2-ba71-c645d1095f77]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KkiIdfsY {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81da5d0c-ce, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81da5d0c-ce, col_values=(('external_ids', {'iface-id': '81da5d0c-cecc-40d5-b7d4-332741f3c96f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:bd:cb', 'vm-uuid': 'bac3dbae-0134-450c-9220-0dd96e74aef0'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:10:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=6972MB free_disk=25.600139617919922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: INFO os_vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:bd:cb,bridge_name='br-int',has_traffic_filtering=True,id=81da5d0c-cecc-40d5-b7d4-332741f3c96f,network=Network(1759d93e-5701-4061-b3b6-e192d31f3d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81da5d0c-ce')
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:96:78,bridge_name='br-int',has_traffic_filtering=True,id=45f2c112-2fab-4db9-8476-8639488f678a,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45f2c112-2f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:96:78,bridge_name='br-int',has_traffic_filtering=True,id=45f2c112-2fab-4db9-8476-8639488f678a,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45f2c112-2f') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KkiIdfsY" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[40db9d0e-6b04-4472-9f11-e9398ed7ffab]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KkiIdfsY'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45f2c112-2f, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45f2c112-2f, col_values=(('external_ids', {'iface-id': '45f2c112-2fab-4db9-8476-8639488f678a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:96:78', 'vm-uuid': 'bac3dbae-0134-450c-9220-0dd96e74aef0'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[15acacc9-022a-4464-8f8a-e205e0b58cd6]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: INFO os_vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:96:78,bridge_name='br-int',has_traffic_filtering=True,id=45f2c112-2fab-4db9-8476-8639488f678a,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45f2c112-2f')
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:71:2d,bridge_name='br-int',has_traffic_filtering=True,id=c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6ed638e-4f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:71:2d,bridge_name='br-int',has_traffic_filtering=True,id=c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6ed638e-4f') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6ed638e-4f, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6ed638e-4f, col_values=(('external_ids', {'iface-id': 'c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:71:2d', 'vm-uuid': 'bac3dbae-0134-450c-9220-0dd96e74aef0'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxgdsd9a1/dc354e7ada314b0089274bccd8077bac.delta /opt/stack/data/nova/instances/snapshots/tmpxgdsd9a1/dc354e7ada314b0089274bccd8077bac {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e378a8d9-a89e-4ca1-9d6a-8139c1ea940b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:10:25 user nova-compute[73091]: INFO os_vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:71:2d,bridge_name='br-int',has_traffic_filtering=True,id=c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6ed638e-4f')
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "address": "fa:16:3e:0c:14:b8", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404c0ed4-2b", "ovs_interfaceid": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "address": "fa:16:3e:0c:14:b8", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404c0ed4-2b", "ovs_interfaceid": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=404c0ed4-2bc5-4608-8a0e-4f71a08c7b74,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404c0ed4-2b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=404c0ed4-2bc5-4608-8a0e-4f71a08c7b74,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404c0ed4-2b') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap404c0ed4-2b, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap404c0ed4-2b, col_values=(('external_ids', {'iface-id': '404c0ed4-2bc5-4608-8a0e-4f71a08c7b74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:14:b8', 'vm-uuid': 'bac3dbae-0134-450c-9220-0dd96e74aef0'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: INFO os_vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=404c0ed4-2bc5-4608-8a0e-4f71a08c7b74,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404c0ed4-2b')
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:28:16,bridge_name='br-int',has_traffic_filtering=True,id=e28992b9-adef-431a-8323-eff7c955648b,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28992b9-ad') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:28:16,bridge_name='br-int',has_traffic_filtering=True,id=e28992b9-adef-431a-8323-eff7c955648b,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28992b9-ad') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce784ad-eb58-4602-bf51-033bea36a823]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc, portal: 172.16.0.220,3260]
Aug 16 08:10:25 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc, portal: 172.16.0.220,3260] successful.
Aug 16 08:10:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape28992b9-ad, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape28992b9-ad, col_values=(('external_ids', {'iface-id': 'e28992b9-adef-431a-8323-eff7c955648b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:28:16', 'vm-uuid': 'bac3dbae-0134-450c-9220-0dd96e74aef0'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance bd541280-cecf-4c1c-bd1f-f7edff830f1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4a6248b9-f577-4efd-baa2-eb5eb3e47495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance cc7973d9-c703-4345-bf58-ccbe80fd07ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance daf2b789-eba2-419b-99f6-be8f483151ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 476de8ea-30dd-4b52-be37-f134e445757f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 90ad75e0-f191-418b-a970-41fcfd500a77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance b4e06e3b-5389-4054-aa47-d9cf7b638c0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 6060dcaf-e451-4308-b96f-43bcbf56d621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance a7ae44fc-14fd-457c-8ae7-d8c65df6be2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 58fb6a40-f818-4515-be92-9f5dd96e40d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance bac3dbae-0134-450c-9220-0dd96e74aef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 5b610a48-4130-48db-91af-0f3926ac775b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3b249b-4d8d-499d-a870-ee2a966002e9]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: INFO os_vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:28:16,bridge_name='br-int',has_traffic_filtering=True,id=e28992b9-adef-431a-8323-eff7c955648b,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28992b9-ad')
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "address": "fa:16:3e:09:f9:0a", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c3edd9-64", "ovs_interfaceid": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "address": "fa:16:3e:09:f9:0a", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c3edd9-64", "ovs_interfaceid": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=95c3edd9-641c-4059-9d3f-553918cf9a2e,network=Network(91679214-2ee2-419f-8daf-b712380c2fb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c3edd9-64') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=95c3edd9-641c-4059-9d3f-553918cf9a2e,network=Network(91679214-2ee2-419f-8daf-b712380c2fb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c3edd9-64') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95c3edd9-64, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95c3edd9-64, col_values=(('external_ids', {'iface-id': '95c3edd9-641c-4059-9d3f-553918cf9a2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:f9:0a', 'vm-uuid': 'bac3dbae-0134-450c-9220-0dd96e74aef0'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8a176a-ccc0-4bf8-8ce4-c8f023f035e0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:10:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:10:25 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:10:25 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.914s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0b0cb9-8da5-4e58-8c5e-2697e17a3c02]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KkiIdfsY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: INFO os_vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=95c3edd9-641c-4059-9d3f-553918cf9a2e,network=Network(91679214-2ee2-419f-8daf-b712380c2fb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c3edd9-64')
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2725555-04ce-4049-ad18-6c7164352ea0", "address": "fa:16:3e:7f:c1:00", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2725555-04", "ovs_interfaceid": "b2725555-04ce-4049-ad18-6c7164352ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "b2725555-04ce-4049-ad18-6c7164352ea0", "address": "fa:16:3e:7f:c1:00", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2725555-04", "ovs_interfaceid": "b2725555-04ce-4049-ad18-6c7164352ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c1:00,bridge_name='br-int',has_traffic_filtering=True,id=b2725555-04ce-4049-ad18-6c7164352ea0,network=Network(91679214-2ee2-419f-8daf-b712380c2fb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2725555-04') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG os_vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c1:00,bridge_name='br-int',has_traffic_filtering=True,id=b2725555-04ce-4049-ad18-6c7164352ea0,network=Network(91679214-2ee2-419f-8daf-b712380c2fb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2725555-04') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2725555-04, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2725555-04, col_values=(('external_ids', {'iface-id': 'b2725555-04ce-4049-ad18-6c7164352ea0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:c1:00', 'vm-uuid': 'bac3dbae-0134-450c-9220-0dd96e74aef0'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:10:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxgdsd9a1/dc354e7ada314b0089274bccd8077bac.delta /opt/stack/data/nova/instances/snapshots/tmpxgdsd9a1/dc354e7ada314b0089274bccd8077bac" returned: 0 in 0.371s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Snapshot extracted, beginning image upload
Aug 16 08:10:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:25 user nova-compute[73091]: INFO os_vif [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c1:00,bridge_name='br-int',has_traffic_filtering=True,id=b2725555-04ce-4049-ad18-6c7164352ea0,network=Network(91679214-2ee2-419f-8daf-b712380c2fb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2725555-04')
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] No BDM found with device name hda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] No VIF found with MAC fa:16:3e:26:bd:cb, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] No VIF found with MAC fa:16:3e:0d:28:16, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:10:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Using config drive
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.837s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Creating config drive at /opt/stack/data/nova/instances/bac3dbae-0134-450c-9220-0dd96e74aef0/disk.config
Aug 16 08:10:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bac3dbae-0134-450c-9220-0dd96e74aef0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp52pcyk6e {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bac3dbae-0134-450c-9220-0dd96e74aef0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp52pcyk6e" returned: 0 in 0.054s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.960s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] <== connect_volume: return (3327ms) {'type': 'block', 'scsi_wwn': '23663636235313462', 'path': '/dev/sdh'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663636235313462', 'path': '/dev/sdh'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2008915e-4e3b-4433-94c5-b837a4533e72", "address": "fa:16:3e:27:b1:72", "network": {"id": "08557a22-e386-4104-8e71-09e5287b1560", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-735103643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008915e-4e", "ovs_interfaceid": "2008915e-4e3b-4433-94c5-b837a4533e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "2008915e-4e3b-4433-94c5-b837a4533e72", "address": "fa:16:3e:27:b1:72", "network": {"id": "08557a22-e386-4104-8e71-09e5287b1560", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-735103643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008915e-4e", "ovs_interfaceid": "2008915e-4e3b-4433-94c5-b837a4533e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:b1:72,bridge_name='br-int',has_traffic_filtering=True,id=2008915e-4e3b-4433-94c5-b837a4533e72,network=Network(08557a22-e386-4104-8e71-09e5287b1560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2008915e-4e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98aea5dd-a8b3-493c-88b7-39b279a71065", "address": "fa:16:3e:2e:16:79", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aea5dd-a8", "ovs_interfaceid": "98aea5dd-a8b3-493c-88b7-39b279a71065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "98aea5dd-a8b3-493c-88b7-39b279a71065", "address": "fa:16:3e:2e:16:79", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aea5dd-a8", "ovs_interfaceid": "98aea5dd-a8b3-493c-88b7-39b279a71065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:16:79,bridge_name='br-int',has_traffic_filtering=True,id=98aea5dd-a8b3-493c-88b7-39b279a71065,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98aea5dd-a8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "address": "fa:16:3e:c1:b6:6b", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6f6e98-0c", "ovs_interfaceid": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "address": "fa:16:3e:c1:b6:6b", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6f6e98-0c", "ovs_interfaceid": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b6:6b,bridge_name='br-int',has_traffic_filtering=True,id=3c6f6e98-0c46-4f70-b579-6dfb0d9fb684,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c6f6e98-0c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "address": "fa:16:3e:98:9d:73", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12399afc-df", "ovs_interfaceid": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "address": "fa:16:3e:98:9d:73", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12399afc-df", "ovs_interfaceid": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:73,bridge_name='br-int',has_traffic_filtering=True,id=12399afc-df8c-4c43-bf0f-20b6e8d16f12,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12399afc-df') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "address": "fa:16:3e:97:e5:41", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f21c70-35", "ovs_interfaceid": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "address": "fa:16:3e:97:e5:41", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f21c70-35", "ovs_interfaceid": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:e5:41,bridge_name='br-int',has_traffic_filtering=True,id=55f21c70-3596-4c1f-9688-d1c03967e6c0,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f21c70-35') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3016cdef-2342-41d7-af0a-feee127affa8", "address": "fa:16:3e:3c:0a:32", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3016cdef-23", "ovs_interfaceid": "3016cdef-2342-41d7-af0a-feee127affa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "3016cdef-2342-41d7-af0a-feee127affa8", "address": "fa:16:3e:3c:0a:32", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3016cdef-23", "ovs_interfaceid": "3016cdef-2342-41d7-af0a-feee127affa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:0a:32,bridge_name='br-int',has_traffic_filtering=True,id=3016cdef-2342-41d7-af0a-feee127affa8,network=Network(d1508b84-5f7e-474d-b85a-1488dc467b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3016cdef-23') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "address": "fa:16:3e:35:54:2d", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13190e58-60", "ovs_interfaceid": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "address": "fa:16:3e:35:54:2d", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13190e58-60", "ovs_interfaceid": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:54:2d,bridge_name='br-int',has_traffic_filtering=True,id=13190e58-602a-4b42-b35d-c5d977e0cbb9,network=Network(d1508b84-5f7e-474d-b85a-1488dc467b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13190e58-60') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b610a48-4130-48db-91af-0f3926ac775b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:10:26 user nova-compute[73091]:   <uuid>5b610a48-4130-48db-91af-0f3926ac775b</uuid>
Aug 16 08:10:26 user nova-compute[73091]:   <name>instance-0000000c</name>
Aug 16 08:10:26 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:10:26 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:10:26 user nova-compute[73091]:   <metadata>
Aug 16 08:10:26 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:10:26 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:10:26 user nova-compute[73091]:       <nova:name>tempest-device-tagging-server-369925601</nova:name>
Aug 16 08:10:26 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:10:18</nova:creationTime>
Aug 16 08:10:26 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:10:26 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:10:26 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:10:26 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:10:26 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:10:26 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:10:26 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:10:26 user nova-compute[73091]:       <nova:owner>
Aug 16 08:10:26 user nova-compute[73091]:         <nova:user uuid="4180033cfe414478a8d71b7eab618f30">tempest-TaggedBootDevicesTest-1126604454-project-member</nova:user>
Aug 16 08:10:26 user nova-compute[73091]:         <nova:project uuid="a4ab62fd66c14cab96934322638feca6">tempest-TaggedBootDevicesTest-1126604454</nova:project>
Aug 16 08:10:26 user nova-compute[73091]:       </nova:owner>
Aug 16 08:10:26 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:10:26 user nova-compute[73091]:       <nova:ports>
Aug 16 08:10:26 user nova-compute[73091]:         <nova:port uuid="2008915e-4e3b-4433-94c5-b837a4533e72">
Aug 16 08:10:26 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 08:10:26 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:26 user nova-compute[73091]:         <nova:port uuid="98aea5dd-a8b3-493c-88b7-39b279a71065">
Aug 16 08:10:26 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.163" ipVersion="4"/>
Aug 16 08:10:26 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:26 user nova-compute[73091]:         <nova:port uuid="3c6f6e98-0c46-4f70-b579-6dfb0d9fb684">
Aug 16 08:10:26 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.56" ipVersion="4"/>
Aug 16 08:10:26 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:26 user nova-compute[73091]:         <nova:port uuid="12399afc-df8c-4c43-bf0f-20b6e8d16f12">
Aug 16 08:10:26 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.168" ipVersion="4"/>
Aug 16 08:10:26 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:26 user nova-compute[73091]:         <nova:port uuid="55f21c70-3596-4c1f-9688-d1c03967e6c0">
Aug 16 08:10:26 user nova-compute[73091]:           <nova:ip type="fixed" address="10.1.1.204" ipVersion="4"/>
Aug 16 08:10:26 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:26 user nova-compute[73091]:         <nova:port uuid="3016cdef-2342-41d7-af0a-feee127affa8">
Aug 16 08:10:26 user nova-compute[73091]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 08:10:26 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:26 user nova-compute[73091]:         <nova:port uuid="13190e58-602a-4b42-b35d-c5d977e0cbb9">
Aug 16 08:10:26 user nova-compute[73091]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 08:10:26 user nova-compute[73091]:         </nova:port>
Aug 16 08:10:26 user nova-compute[73091]:       </nova:ports>
Aug 16 08:10:26 user nova-compute[73091]:     </nova:instance>
Aug 16 08:10:26 user nova-compute[73091]:   </metadata>
Aug 16 08:10:26 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:10:26 user nova-compute[73091]:     <system>
Aug 16 08:10:26 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:10:26 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:10:26 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:10:26 user nova-compute[73091]:       <entry name="serial">5b610a48-4130-48db-91af-0f3926ac775b</entry>
Aug 16 08:10:26 user nova-compute[73091]:       <entry name="uuid">5b610a48-4130-48db-91af-0f3926ac775b</entry>
Aug 16 08:10:26 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:10:26 user nova-compute[73091]:     </system>
Aug 16 08:10:26 user nova-compute[73091]:   </sysinfo>
Aug 16 08:10:26 user nova-compute[73091]:   <os>
Aug 16 08:10:26 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:10:26 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:10:26 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:10:26 user nova-compute[73091]:   </os>
Aug 16 08:10:26 user nova-compute[73091]:   <features>
Aug 16 08:10:26 user nova-compute[73091]:     <acpi/>
Aug 16 08:10:26 user nova-compute[73091]:     <apic/>
Aug 16 08:10:26 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:10:26 user nova-compute[73091]:   </features>
Aug 16 08:10:26 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:10:26 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:10:26 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:10:26 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:10:26 user nova-compute[73091]:   </clock>
Aug 16 08:10:26 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:10:26 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:10:26 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:10:26 user nova-compute[73091]:   </cpu>
Aug 16 08:10:26 user nova-compute[73091]:   <devices>
Aug 16 08:10:26 user nova-compute[73091]:     <disk type="file" device="cdrom">
Aug 16 08:10:26 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 08:10:26 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/5b610a48-4130-48db-91af-0f3926ac775b/disk.config"/>
Aug 16 08:10:26 user nova-compute[73091]:       <target dev="hda" bus="ide"/>
Aug 16 08:10:26 user nova-compute[73091]:     </disk>
Aug 16 08:10:26 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:10:26 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:10:26 user nova-compute[73091]:       <source dev="/dev/sdd"/>
Aug 16 08:10:26 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:10:26 user nova-compute[73091]:       <serial>369fe995-f701-42e3-92e9-fcbc3c536680</serial>
Aug 16 08:10:26 user nova-compute[73091]:     </disk>
Aug 16 08:10:26 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:10:26 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:10:26 user nova-compute[73091]:       <source dev="/dev/sdf"/>
Aug 16 08:10:26 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 08:10:26 user nova-compute[73091]:       <serial>3c4295bb-295f-4da8-bc40-72722984a3a1</serial>
Aug 16 08:10:26 user nova-compute[73091]:     </disk>
Aug 16 08:10:26 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:10:26 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:10:26 user nova-compute[73091]:       <source dev="/dev/sdh"/>
Aug 16 08:10:26 user nova-compute[73091]:       <target dev="vdc" bus="virtio"/>
Aug 16 08:10:26 user nova-compute[73091]:       <serial>af07271b-6693-42cb-bee0-00e7417be1bc</serial>
Aug 16 08:10:26 user nova-compute[73091]:     </disk>
Aug 16 08:10:26 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:26 user nova-compute[73091]:       <mac address="fa:16:3e:27:b1:72"/>
Aug 16 08:10:26 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:26 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:26 user nova-compute[73091]:       <target dev="tap2008915e-4e"/>
Aug 16 08:10:26 user nova-compute[73091]:     </interface>
Aug 16 08:10:26 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:26 user nova-compute[73091]:       <mac address="fa:16:3e:2e:16:79"/>
Aug 16 08:10:26 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:26 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:26 user nova-compute[73091]:       <target dev="tap98aea5dd-a8"/>
Aug 16 08:10:26 user nova-compute[73091]:     </interface>
Aug 16 08:10:26 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:26 user nova-compute[73091]:       <mac address="fa:16:3e:c1:b6:6b"/>
Aug 16 08:10:26 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:26 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:26 user nova-compute[73091]:       <target dev="tap3c6f6e98-0c"/>
Aug 16 08:10:26 user nova-compute[73091]:     </interface>
Aug 16 08:10:26 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:26 user nova-compute[73091]:       <mac address="fa:16:3e:98:9d:73"/>
Aug 16 08:10:26 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:26 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:26 user nova-compute[73091]:       <target dev="tap12399afc-df"/>
Aug 16 08:10:26 user nova-compute[73091]:     </interface>
Aug 16 08:10:26 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:26 user nova-compute[73091]:       <mac address="fa:16:3e:97:e5:41"/>
Aug 16 08:10:26 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:26 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:26 user nova-compute[73091]:       <target dev="tap55f21c70-35"/>
Aug 16 08:10:26 user nova-compute[73091]:     </interface>
Aug 16 08:10:26 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:26 user nova-compute[73091]:       <mac address="fa:16:3e:3c:0a:32"/>
Aug 16 08:10:26 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:26 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:26 user nova-compute[73091]:       <target dev="tap3016cdef-23"/>
Aug 16 08:10:26 user nova-compute[73091]:     </interface>
Aug 16 08:10:26 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:10:26 user nova-compute[73091]:       <mac address="fa:16:3e:35:54:2d"/>
Aug 16 08:10:26 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:26 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:10:26 user nova-compute[73091]:       <target dev="tap13190e58-60"/>
Aug 16 08:10:26 user nova-compute[73091]:     </interface>
Aug 16 08:10:26 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:10:26 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/5b610a48-4130-48db-91af-0f3926ac775b/console.log" append="off"/>
Aug 16 08:10:26 user nova-compute[73091]:     </serial>
Aug 16 08:10:26 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:10:26 user nova-compute[73091]:     <video>
Aug 16 08:10:26 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:10:26 user nova-compute[73091]:     </video>
Aug 16 08:10:26 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:10:26 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:10:26 user nova-compute[73091]:     </rng>
Aug 16 08:10:26 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:10:26 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:10:26 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:10:26 user nova-compute[73091]:     </memballoon>
Aug 16 08:10:26 user nova-compute[73091]:   </devices>
Aug 16 08:10:26 user nova-compute[73091]: </domain>
Aug 16 08:10:26 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2008915e-4e3b-4433-94c5-b837a4533e72", "address": "fa:16:3e:27:b1:72", "network": {"id": "08557a22-e386-4104-8e71-09e5287b1560", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-735103643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008915e-4e", "ovs_interfaceid": "2008915e-4e3b-4433-94c5-b837a4533e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "2008915e-4e3b-4433-94c5-b837a4533e72", "address": "fa:16:3e:27:b1:72", "network": {"id": "08557a22-e386-4104-8e71-09e5287b1560", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-735103643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008915e-4e", "ovs_interfaceid": "2008915e-4e3b-4433-94c5-b837a4533e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:b1:72,bridge_name='br-int',has_traffic_filtering=True,id=2008915e-4e3b-4433-94c5-b837a4533e72,network=Network(08557a22-e386-4104-8e71-09e5287b1560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2008915e-4e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG os_vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:b1:72,bridge_name='br-int',has_traffic_filtering=True,id=2008915e-4e3b-4433-94c5-b837a4533e72,network=Network(08557a22-e386-4104-8e71-09e5287b1560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2008915e-4e') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2008915e-4e, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2008915e-4e, col_values=(('external_ids', {'iface-id': '2008915e-4e3b-4433-94c5-b837a4533e72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:b1:72', 'vm-uuid': '5b610a48-4130-48db-91af-0f3926ac775b'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: INFO os_vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:b1:72,bridge_name='br-int',has_traffic_filtering=True,id=2008915e-4e3b-4433-94c5-b837a4533e72,network=Network(08557a22-e386-4104-8e71-09e5287b1560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2008915e-4e')
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98aea5dd-a8b3-493c-88b7-39b279a71065", "address": "fa:16:3e:2e:16:79", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aea5dd-a8", "ovs_interfaceid": "98aea5dd-a8b3-493c-88b7-39b279a71065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "98aea5dd-a8b3-493c-88b7-39b279a71065", "address": "fa:16:3e:2e:16:79", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aea5dd-a8", "ovs_interfaceid": "98aea5dd-a8b3-493c-88b7-39b279a71065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:16:79,bridge_name='br-int',has_traffic_filtering=True,id=98aea5dd-a8b3-493c-88b7-39b279a71065,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98aea5dd-a8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG os_vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:16:79,bridge_name='br-int',has_traffic_filtering=True,id=98aea5dd-a8b3-493c-88b7-39b279a71065,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98aea5dd-a8') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98aea5dd-a8, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98aea5dd-a8, col_values=(('external_ids', {'iface-id': '98aea5dd-a8b3-493c-88b7-39b279a71065', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:16:79', 'vm-uuid': '5b610a48-4130-48db-91af-0f3926ac775b'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:10:27 user nova-compute[73091]: INFO os_vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:16:79,bridge_name='br-int',has_traffic_filtering=True,id=98aea5dd-a8b3-493c-88b7-39b279a71065,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98aea5dd-a8')
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "address": "fa:16:3e:c1:b6:6b", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6f6e98-0c", "ovs_interfaceid": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "address": "fa:16:3e:c1:b6:6b", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6f6e98-0c", "ovs_interfaceid": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b6:6b,bridge_name='br-int',has_traffic_filtering=True,id=3c6f6e98-0c46-4f70-b579-6dfb0d9fb684,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c6f6e98-0c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG os_vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b6:6b,bridge_name='br-int',has_traffic_filtering=True,id=3c6f6e98-0c46-4f70-b579-6dfb0d9fb684,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c6f6e98-0c') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c6f6e98-0c, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c6f6e98-0c, col_values=(('external_ids', {'iface-id': '3c6f6e98-0c46-4f70-b579-6dfb0d9fb684', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:b6:6b', 'vm-uuid': '5b610a48-4130-48db-91af-0f3926ac775b'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: INFO os_vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b6:6b,bridge_name='br-int',has_traffic_filtering=True,id=3c6f6e98-0c46-4f70-b579-6dfb0d9fb684,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c6f6e98-0c')
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "address": "fa:16:3e:98:9d:73", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12399afc-df", "ovs_interfaceid": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "address": "fa:16:3e:98:9d:73", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12399afc-df", "ovs_interfaceid": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:73,bridge_name='br-int',has_traffic_filtering=True,id=12399afc-df8c-4c43-bf0f-20b6e8d16f12,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12399afc-df') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG os_vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:73,bridge_name='br-int',has_traffic_filtering=True,id=12399afc-df8c-4c43-bf0f-20b6e8d16f12,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12399afc-df') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12399afc-df, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12399afc-df, col_values=(('external_ids', {'iface-id': '12399afc-df8c-4c43-bf0f-20b6e8d16f12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:9d:73', 'vm-uuid': '5b610a48-4130-48db-91af-0f3926ac775b'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: INFO os_vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:73,bridge_name='br-int',has_traffic_filtering=True,id=12399afc-df8c-4c43-bf0f-20b6e8d16f12,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12399afc-df')
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "address": "fa:16:3e:97:e5:41", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f21c70-35", "ovs_interfaceid": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "address": "fa:16:3e:97:e5:41", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f21c70-35", "ovs_interfaceid": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:e5:41,bridge_name='br-int',has_traffic_filtering=True,id=55f21c70-3596-4c1f-9688-d1c03967e6c0,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f21c70-35') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG os_vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:e5:41,bridge_name='br-int',has_traffic_filtering=True,id=55f21c70-3596-4c1f-9688-d1c03967e6c0,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f21c70-35') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55f21c70-35, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55f21c70-35, col_values=(('external_ids', {'iface-id': '55f21c70-3596-4c1f-9688-d1c03967e6c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:e5:41', 'vm-uuid': '5b610a48-4130-48db-91af-0f3926ac775b'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquired lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: INFO os_vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:e5:41,bridge_name='br-int',has_traffic_filtering=True,id=55f21c70-3596-4c1f-9688-d1c03967e6c0,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f21c70-35')
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3016cdef-2342-41d7-af0a-feee127affa8", "address": "fa:16:3e:3c:0a:32", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3016cdef-23", "ovs_interfaceid": "3016cdef-2342-41d7-af0a-feee127affa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "3016cdef-2342-41d7-af0a-feee127affa8", "address": "fa:16:3e:3c:0a:32", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3016cdef-23", "ovs_interfaceid": "3016cdef-2342-41d7-af0a-feee127affa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:0a:32,bridge_name='br-int',has_traffic_filtering=True,id=3016cdef-2342-41d7-af0a-feee127affa8,network=Network(d1508b84-5f7e-474d-b85a-1488dc467b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3016cdef-23') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG os_vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:0a:32,bridge_name='br-int',has_traffic_filtering=True,id=3016cdef-2342-41d7-af0a-feee127affa8,network=Network(d1508b84-5f7e-474d-b85a-1488dc467b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3016cdef-23') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3016cdef-23, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3016cdef-23, col_values=(('external_ids', {'iface-id': '3016cdef-2342-41d7-af0a-feee127affa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:0a:32', 'vm-uuid': '5b610a48-4130-48db-91af-0f3926ac775b'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:28 user nova-compute[73091]: INFO os_vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:0a:32,bridge_name='br-int',has_traffic_filtering=True,id=3016cdef-2342-41d7-af0a-feee127affa8,network=Network(d1508b84-5f7e-474d-b85a-1488dc467b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3016cdef-23')
Aug 16 08:10:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "address": "fa:16:3e:35:54:2d", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13190e58-60", "ovs_interfaceid": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "address": "fa:16:3e:35:54:2d", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13190e58-60", "ovs_interfaceid": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:54:2d,bridge_name='br-int',has_traffic_filtering=True,id=13190e58-602a-4b42-b35d-c5d977e0cbb9,network=Network(d1508b84-5f7e-474d-b85a-1488dc467b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13190e58-60') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG os_vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:54:2d,bridge_name='br-int',has_traffic_filtering=True,id=13190e58-602a-4b42-b35d-c5d977e0cbb9,network=Network(d1508b84-5f7e-474d-b85a-1488dc467b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13190e58-60') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13190e58-60, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13190e58-60, col_values=(('external_ids', {'iface-id': '13190e58-602a-4b42-b35d-c5d977e0cbb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:54:2d', 'vm-uuid': '5b610a48-4130-48db-91af-0f3926ac775b'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:28 user nova-compute[73091]: INFO os_vif [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:54:2d,bridge_name='br-int',has_traffic_filtering=True,id=13190e58-602a-4b42-b35d-c5d977e0cbb9,network=Network(d1508b84-5f7e-474d-b85a-1488dc467b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13190e58-60')
Aug 16 08:10:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] No BDM found with device name hda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] No VIF found with MAC fa:16:3e:27:b1:72, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] No VIF found with MAC fa:16:3e:97:e5:41, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:10:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Using config drive
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Snapshot image upload complete
Aug 16 08:10:29 user nova-compute[73091]: INFO nova.compute.manager [None req-f4995296-31fc-46e1-800c-9d0598548e08 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Took 6.40 seconds to snapshot the instance on the hypervisor.
Aug 16 08:10:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-807e6e29-84d8-41a3-b2ba-fa2a0af48d2f req-e27cc2a3-413f-4b77-997a-ef1a0b98b4d6 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-45f2c112-2fab-4db9-8476-8639488f678a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-807e6e29-84d8-41a3-b2ba-fa2a0af48d2f req-e27cc2a3-413f-4b77-997a-ef1a0b98b4d6 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-807e6e29-84d8-41a3-b2ba-fa2a0af48d2f req-e27cc2a3-413f-4b77-997a-ef1a0b98b4d6 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-807e6e29-84d8-41a3-b2ba-fa2a0af48d2f req-e27cc2a3-413f-4b77-997a-ef1a0b98b4d6 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-807e6e29-84d8-41a3-b2ba-fa2a0af48d2f req-e27cc2a3-413f-4b77-997a-ef1a0b98b4d6 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-45f2c112-2fab-4db9-8476-8639488f678a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:29 user nova-compute[73091]: WARNING nova.compute.manager [req-807e6e29-84d8-41a3-b2ba-fa2a0af48d2f req-e27cc2a3-413f-4b77-997a-ef1a0b98b4d6 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-45f2c112-2fab-4db9-8476-8639488f678a for instance with vm_state building and task_state spawning.
Aug 16 08:10:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Creating config drive at /opt/stack/data/nova/instances/5b610a48-4130-48db-91af-0f3926ac775b/disk.config
Aug 16 08:10:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5b610a48-4130-48db-91af-0f3926ac775b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd2hatw9g {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5b610a48-4130-48db-91af-0f3926ac775b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd2hatw9g" returned: 0 in 0.115s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-c3d1e142-55dd-433d-86a0-1d1e93e2bed1 req-98194894-e15f-4938-afb5-913581014348 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c3d1e142-55dd-433d-86a0-1d1e93e2bed1 req-98194894-e15f-4938-afb5-913581014348 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c3d1e142-55dd-433d-86a0-1d1e93e2bed1 req-98194894-e15f-4938-afb5-913581014348 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c3d1e142-55dd-433d-86a0-1d1e93e2bed1 req-98194894-e15f-4938-afb5-913581014348 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:29 user nova-compute[73091]: DEBUG nova.compute.manager [req-c3d1e142-55dd-433d-86a0-1d1e93e2bed1 req-98194894-e15f-4938-afb5-913581014348 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:29 user nova-compute[73091]: WARNING nova.compute.manager [req-c3d1e142-55dd-433d-86a0-1d1e93e2bed1 req-98194894-e15f-4938-afb5-913581014348 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-81da5d0c-cecc-40d5-b7d4-332741f3c96f for instance with vm_state building and task_state spawning.
Aug 16 08:10:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Updating instance_info_cache with network_info: [{"id": "e00351b1-2886-496b-9a27-606de620f78d", "address": "fa:16:3e:13:43:df", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00351b1-28", "ovs_interfaceid": "e00351b1-2886-496b-9a27-606de620f78d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Releasing lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-45f2c112-2fab-4db9-8476-8639488f678a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-45f2c112-2fab-4db9-8476-8639488f678a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:31 user nova-compute[73091]: WARNING nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-45f2c112-2fab-4db9-8476-8639488f678a for instance with vm_state building and task_state spawning.
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:31 user nova-compute[73091]: WARNING nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 for instance with vm_state building and task_state spawning.
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:31 user nova-compute[73091]: WARNING nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 for instance with vm_state building and task_state spawning.
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-e28992b9-adef-431a-8323-eff7c955648b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-e28992b9-adef-431a-8323-eff7c955648b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:31 user nova-compute[73091]: WARNING nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-e28992b9-adef-431a-8323-eff7c955648b for instance with vm_state building and task_state spawning.
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-e28992b9-adef-431a-8323-eff7c955648b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-e28992b9-adef-431a-8323-eff7c955648b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:31 user nova-compute[73091]: WARNING nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-e28992b9-adef-431a-8323-eff7c955648b for instance with vm_state building and task_state spawning.
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:31 user nova-compute[73091]: WARNING nova.compute.manager [req-53c0e172-c6f2-40fc-a8f9-66178289c744 req-64c14105-2129-48b0-b02d-412c552e9e6c service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 for instance with vm_state building and task_state spawning.
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-b2847e75-756a-4895-98e2-838fe3548536 req-bdcef794-efe1-4442-a9c6-2b818a011164 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-changed-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-b2847e75-756a-4895-98e2-838fe3548536 req-bdcef794-efe1-4442-a9c6-2b818a011164 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Refreshing instance network info cache due to event network-changed-1acfd5b5-3ae9-44d0-822d-7382be3fd551. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b2847e75-756a-4895-98e2-838fe3548536 req-bdcef794-efe1-4442-a9c6-2b818a011164 service nova] Acquiring lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b2847e75-756a-4895-98e2-838fe3548536 req-bdcef794-efe1-4442-a9c6-2b818a011164 service nova] Acquired lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-b2847e75-756a-4895-98e2-838fe3548536 req-bdcef794-efe1-4442-a9c6-2b818a011164 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Refreshing network info cache for port 1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Received event network-changed-a8445f80-1201-4794-b715-36e357399997 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Refreshing instance network info cache due to event network-changed-a8445f80-1201-4794-b715-36e357399997. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Acquiring lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Acquired lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG nova.network.neutron [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Refreshing network info cache for port a8445f80-1201-4794-b715-36e357399997 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG nova.network.neutron [req-b2847e75-756a-4895-98e2-838fe3548536 req-bdcef794-efe1-4442-a9c6-2b818a011164 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updated VIF entry in instance network info cache for port 1acfd5b5-3ae9-44d0-822d-7382be3fd551. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG nova.network.neutron [req-b2847e75-756a-4895-98e2-838fe3548536 req-bdcef794-efe1-4442-a9c6-2b818a011164 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating instance_info_cache with network_info: [{"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b2847e75-756a-4895-98e2-838fe3548536 req-bdcef794-efe1-4442-a9c6-2b818a011164 service nova] Releasing lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.network.neutron [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Updated VIF entry in instance network info cache for port a8445f80-1201-4794-b715-36e357399997. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.network.neutron [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Updating instance_info_cache with network_info: [{"id": "a8445f80-1201-4794-b715-36e357399997", "address": "fa:16:3e:d2:ee:e5", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8445f80-12", "ovs_interfaceid": "a8445f80-1201-4794-b715-36e357399997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Releasing lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:33 user nova-compute[73091]: WARNING nova.compute.manager [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-81da5d0c-cecc-40d5-b7d4-332741f3c96f for instance with vm_state building and task_state spawning.
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:33 user nova-compute[73091]: WARNING nova.compute.manager [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 for instance with vm_state building and task_state spawning.
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:33 user nova-compute[73091]: WARNING nova.compute.manager [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 for instance with vm_state building and task_state spawning.
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-95c3edd9-641c-4059-9d3f-553918cf9a2e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-95c3edd9-641c-4059-9d3f-553918cf9a2e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:33 user nova-compute[73091]: WARNING nova.compute.manager [req-679f7600-f083-4279-bf4c-2bc184db65df req-f303b991-ac1c-42ff-b0c7-5d73b11490af service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-95c3edd9-641c-4059-9d3f-553918cf9a2e for instance with vm_state building and task_state spawning.
Aug 16 08:10:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:33 user nova-compute[73091]: WARNING nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 for instance with vm_state building and task_state spawning.
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:33 user nova-compute[73091]: WARNING nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-2008915e-4e3b-4433-94c5-b837a4533e72 for instance with vm_state building and task_state spawning.
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:33 user nova-compute[73091]: WARNING nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-2008915e-4e3b-4433-94c5-b837a4533e72 for instance with vm_state building and task_state spawning.
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-98aea5dd-a8b3-493c-88b7-39b279a71065 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-98aea5dd-a8b3-493c-88b7-39b279a71065 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:33 user nova-compute[73091]: WARNING nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-98aea5dd-a8b3-493c-88b7-39b279a71065 for instance with vm_state building and task_state spawning.
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-98aea5dd-a8b3-493c-88b7-39b279a71065 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-98aea5dd-a8b3-493c-88b7-39b279a71065 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:33 user nova-compute[73091]: WARNING nova.compute.manager [req-b269176e-3ce5-4b9c-914b-d3e62bb3e730 req-f024c8b7-2d19-4e5c-8d8e-e23615336ead service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-98aea5dd-a8b3-493c-88b7-39b279a71065 for instance with vm_state building and task_state spawning.
Aug 16 08:10:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-d7c2cf89-563f-4815-a00d-93db4bfc4e96 req-415df9de-6b77-4197-980a-630572d6d55d service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-95c3edd9-641c-4059-9d3f-553918cf9a2e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7c2cf89-563f-4815-a00d-93db4bfc4e96 req-415df9de-6b77-4197-980a-630572d6d55d service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7c2cf89-563f-4815-a00d-93db4bfc4e96 req-415df9de-6b77-4197-980a-630572d6d55d service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d7c2cf89-563f-4815-a00d-93db4bfc4e96 req-415df9de-6b77-4197-980a-630572d6d55d service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-d7c2cf89-563f-4815-a00d-93db4bfc4e96 req-415df9de-6b77-4197-980a-630572d6d55d service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-95c3edd9-641c-4059-9d3f-553918cf9a2e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:33 user nova-compute[73091]: WARNING nova.compute.manager [req-d7c2cf89-563f-4815-a00d-93db4bfc4e96 req-415df9de-6b77-4197-980a-630572d6d55d service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-95c3edd9-641c-4059-9d3f-553918cf9a2e for instance with vm_state building and task_state spawning.
Aug 16 08:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-6d8244db-b947-4f0f-81de-6618063cf19f req-c160e75e-c64c-4f41-bfa1-e0c8dbe0bc02 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-3016cdef-2342-41d7-af0a-feee127affa8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6d8244db-b947-4f0f-81de-6618063cf19f req-c160e75e-c64c-4f41-bfa1-e0c8dbe0bc02 service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6d8244db-b947-4f0f-81de-6618063cf19f req-c160e75e-c64c-4f41-bfa1-e0c8dbe0bc02 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6d8244db-b947-4f0f-81de-6618063cf19f req-c160e75e-c64c-4f41-bfa1-e0c8dbe0bc02 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-6d8244db-b947-4f0f-81de-6618063cf19f req-c160e75e-c64c-4f41-bfa1-e0c8dbe0bc02 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-3016cdef-2342-41d7-af0a-feee127affa8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:34 user nova-compute[73091]: WARNING nova.compute.manager [req-6d8244db-b947-4f0f-81de-6618063cf19f req-c160e75e-c64c-4f41-bfa1-e0c8dbe0bc02 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-3016cdef-2342-41d7-af0a-feee127affa8 for instance with vm_state building and task_state spawning.
Aug 16 08:10:34 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173434.9571013, bac3dbae-0134-450c-9220-0dd96e74aef0 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:10:34 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] VM Resumed (Lifecycle Event)
Aug 16 08:10:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:10:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Instance spawned successfully.
Aug 16 08:10:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:10:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:10:35 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173434.9647987, bac3dbae-0134-450c-9220-0dd96e74aef0 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:10:35 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] VM Started (Lifecycle Event)
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:35 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:10:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:35 user nova-compute[73091]: INFO nova.compute.manager [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Took 17.56 seconds to spawn the instance on the hypervisor.
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:10:35 user nova-compute[73091]: INFO nova.compute.manager [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Took 50.42 seconds to build instance.
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-86bdaeda-9763-4afb-b261-5c0d53b600db tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.538s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.013s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:35 user nova-compute[73091]: WARNING nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 for instance with vm_state building and task_state spawning.
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:35 user nova-compute[73091]: WARNING nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 for instance with vm_state building and task_state spawning.
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-12399afc-df8c-4c43-bf0f-20b6e8d16f12 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-12399afc-df8c-4c43-bf0f-20b6e8d16f12 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:35 user nova-compute[73091]: WARNING nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-12399afc-df8c-4c43-bf0f-20b6e8d16f12 for instance with vm_state building and task_state spawning.
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-12399afc-df8c-4c43-bf0f-20b6e8d16f12 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-12399afc-df8c-4c43-bf0f-20b6e8d16f12 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:35 user nova-compute[73091]: WARNING nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-12399afc-df8c-4c43-bf0f-20b6e8d16f12 for instance with vm_state building and task_state spawning.
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-55f21c70-3596-4c1f-9688-d1c03967e6c0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-55f21c70-3596-4c1f-9688-d1c03967e6c0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:35 user nova-compute[73091]: WARNING nova.compute.manager [req-8d537dca-497b-48ef-aee8-249ca97a6a94 req-11f232b8-0ec5-4257-ae86-806f0c9765ec service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-55f21c70-3596-4c1f-9688-d1c03967e6c0 for instance with vm_state building and task_state spawning.
Aug 16 08:10:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-62502a6c-475f-4c06-be22-435572c0f878 req-67516398-4847-4ae0-a667-8510454156fa service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-13190e58-602a-4b42-b35d-c5d977e0cbb9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-62502a6c-475f-4c06-be22-435572c0f878 req-67516398-4847-4ae0-a667-8510454156fa service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-62502a6c-475f-4c06-be22-435572c0f878 req-67516398-4847-4ae0-a667-8510454156fa service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-62502a6c-475f-4c06-be22-435572c0f878 req-67516398-4847-4ae0-a667-8510454156fa service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-62502a6c-475f-4c06-be22-435572c0f878 req-67516398-4847-4ae0-a667-8510454156fa service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-13190e58-602a-4b42-b35d-c5d977e0cbb9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:36 user nova-compute[73091]: WARNING nova.compute.manager [req-62502a6c-475f-4c06-be22-435572c0f878 req-67516398-4847-4ae0-a667-8510454156fa service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-13190e58-602a-4b42-b35d-c5d977e0cbb9 for instance with vm_state building and task_state spawning.
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-62502a6c-475f-4c06-be22-435572c0f878 req-67516398-4847-4ae0-a667-8510454156fa service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-13190e58-602a-4b42-b35d-c5d977e0cbb9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-62502a6c-475f-4c06-be22-435572c0f878 req-67516398-4847-4ae0-a667-8510454156fa service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-62502a6c-475f-4c06-be22-435572c0f878 req-67516398-4847-4ae0-a667-8510454156fa service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-62502a6c-475f-4c06-be22-435572c0f878 req-67516398-4847-4ae0-a667-8510454156fa service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-62502a6c-475f-4c06-be22-435572c0f878 req-67516398-4847-4ae0-a667-8510454156fa service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-13190e58-602a-4b42-b35d-c5d977e0cbb9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:36 user nova-compute[73091]: WARNING nova.compute.manager [req-62502a6c-475f-4c06-be22-435572c0f878 req-67516398-4847-4ae0-a667-8510454156fa service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-13190e58-602a-4b42-b35d-c5d977e0cbb9 for instance with vm_state building and task_state spawning.
Aug 16 08:10:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-6762cb08-d4a1-474c-8bba-c8eca74627f5 req-87e82c9f-5165-4f9d-b57d-59dbc618c28b service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-3016cdef-2342-41d7-af0a-feee127affa8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6762cb08-d4a1-474c-8bba-c8eca74627f5 req-87e82c9f-5165-4f9d-b57d-59dbc618c28b service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6762cb08-d4a1-474c-8bba-c8eca74627f5 req-87e82c9f-5165-4f9d-b57d-59dbc618c28b service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6762cb08-d4a1-474c-8bba-c8eca74627f5 req-87e82c9f-5165-4f9d-b57d-59dbc618c28b service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-6762cb08-d4a1-474c-8bba-c8eca74627f5 req-87e82c9f-5165-4f9d-b57d-59dbc618c28b service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-3016cdef-2342-41d7-af0a-feee127affa8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:36 user nova-compute[73091]: WARNING nova.compute.manager [req-6762cb08-d4a1-474c-8bba-c8eca74627f5 req-87e82c9f-5165-4f9d-b57d-59dbc618c28b service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-3016cdef-2342-41d7-af0a-feee127affa8 for instance with vm_state building and task_state spawning.
Aug 16 08:10:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173436.8860006, 5b610a48-4130-48db-91af-0f3926ac775b => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:10:36 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] VM Resumed (Lifecycle Event)
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:10:36 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Instance spawned successfully.
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:10:36 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173436.8927584, 5b610a48-4130-48db-91af-0f3926ac775b => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:10:36 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] VM Started (Lifecycle Event)
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:10:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:10:37 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:10:37 user nova-compute[73091]: INFO nova.compute.manager [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Took 19.03 seconds to spawn the instance on the hypervisor.
Aug 16 08:10:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:10:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:37 user nova-compute[73091]: INFO nova.compute.manager [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Took 52.00 seconds to build instance.
Aug 16 08:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1aa7e687-034a-4a79-bcad-4d9d92c7fbdf tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "5b610a48-4130-48db-91af-0f3926ac775b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.098s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-c3845031-6d0a-46cd-9f5f-bbc697389b79 req-66608f91-0c65-41c8-84cc-0d0f8db1df11 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-55f21c70-3596-4c1f-9688-d1c03967e6c0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c3845031-6d0a-46cd-9f5f-bbc697389b79 req-66608f91-0c65-41c8-84cc-0d0f8db1df11 service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c3845031-6d0a-46cd-9f5f-bbc697389b79 req-66608f91-0c65-41c8-84cc-0d0f8db1df11 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c3845031-6d0a-46cd-9f5f-bbc697389b79 req-66608f91-0c65-41c8-84cc-0d0f8db1df11 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-c3845031-6d0a-46cd-9f5f-bbc697389b79 req-66608f91-0c65-41c8-84cc-0d0f8db1df11 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-55f21c70-3596-4c1f-9688-d1c03967e6c0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:10:37 user nova-compute[73091]: WARNING nova.compute.manager [req-c3845031-6d0a-46cd-9f5f-bbc697389b79 req-66608f91-0c65-41c8-84cc-0d0f8db1df11 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-55f21c70-3596-4c1f-9688-d1c03967e6c0 for instance with vm_state active and task_state None.
Aug 16 08:10:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:43 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-bc3e7cee-a6b6-44d3-9187-10539ca66c92 req-8f19483f-3191-452b-9beb-2223740a078d service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Received event network-changed-1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-bc3e7cee-a6b6-44d3-9187-10539ca66c92 req-8f19483f-3191-452b-9beb-2223740a078d service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Refreshing instance network info cache due to event network-changed-1c7727db-9b7f-44b2-a649-2042dc3553bb. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:10:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc3e7cee-a6b6-44d3-9187-10539ca66c92 req-8f19483f-3191-452b-9beb-2223740a078d service nova] Acquiring lock "refresh_cache-90ad75e0-f191-418b-a970-41fcfd500a77" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc3e7cee-a6b6-44d3-9187-10539ca66c92 req-8f19483f-3191-452b-9beb-2223740a078d service nova] Acquired lock "refresh_cache-90ad75e0-f191-418b-a970-41fcfd500a77" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-bc3e7cee-a6b6-44d3-9187-10539ca66c92 req-8f19483f-3191-452b-9beb-2223740a078d service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Refreshing network info cache for port 1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:10:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-bc3e7cee-a6b6-44d3-9187-10539ca66c92 req-8f19483f-3191-452b-9beb-2223740a078d service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Updated VIF entry in instance network info cache for port 1c7727db-9b7f-44b2-a649-2042dc3553bb. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:10:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-bc3e7cee-a6b6-44d3-9187-10539ca66c92 req-8f19483f-3191-452b-9beb-2223740a078d service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Updating instance_info_cache with network_info: [{"id": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "address": "fa:16:3e:e1:6f:45", "network": {"id": "5e7781de-6e9b-4788-a042-8db14b7cf340", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1721244661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55e6435f3eed48fa8fe390b82f4cd3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7727db-9b", "ovs_interfaceid": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc3e7cee-a6b6-44d3-9187-10539ca66c92 req-8f19483f-3191-452b-9beb-2223740a078d service nova] Releasing lock "refresh_cache-90ad75e0-f191-418b-a970-41fcfd500a77" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-bc63f9f4-65e4-4c16-bcfc-2dce4923a28e req-1b258c99-b778-48a9-a565-45a80ec48467 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Received event network-changed-f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-bc63f9f4-65e4-4c16-bcfc-2dce4923a28e req-1b258c99-b778-48a9-a565-45a80ec48467 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Refreshing instance network info cache due to event network-changed-f79f747e-9580-4ea0-95a5-d70f3564ebca. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:10:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc63f9f4-65e4-4c16-bcfc-2dce4923a28e req-1b258c99-b778-48a9-a565-45a80ec48467 service nova] Acquiring lock "refresh_cache-b4e06e3b-5389-4054-aa47-d9cf7b638c0f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc63f9f4-65e4-4c16-bcfc-2dce4923a28e req-1b258c99-b778-48a9-a565-45a80ec48467 service nova] Acquired lock "refresh_cache-b4e06e3b-5389-4054-aa47-d9cf7b638c0f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:55 user nova-compute[73091]: DEBUG nova.network.neutron [req-bc63f9f4-65e4-4c16-bcfc-2dce4923a28e req-1b258c99-b778-48a9-a565-45a80ec48467 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Refreshing network info cache for port f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:10:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Acquiring lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:55 user nova-compute[73091]: DEBUG nova.objects.instance [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lazy-loading 'flavor' on Instance uuid b4e06e3b-5389-4054-aa47-d9cf7b638c0f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-bc63f9f4-65e4-4c16-bcfc-2dce4923a28e req-1b258c99-b778-48a9-a565-45a80ec48467 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Updated VIF entry in instance network info cache for port f79f747e-9580-4ea0-95a5-d70f3564ebca. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-bc63f9f4-65e4-4c16-bcfc-2dce4923a28e req-1b258c99-b778-48a9-a565-45a80ec48467 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Updating instance_info_cache with network_info: [{"id": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "address": "fa:16:3e:a4:45:19", "network": {"id": "c88e54d4-1e76-4448-9ff8-28b8a98e4fbf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1243695789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22a1ba2cdb847069b9569ab9fb1aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf79f747e-95", "ovs_interfaceid": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-bc63f9f4-65e4-4c16-bcfc-2dce4923a28e req-1b258c99-b778-48a9-a565-45a80ec48467 service nova] Releasing lock "refresh_cache-b4e06e3b-5389-4054-aa47-d9cf7b638c0f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Acquiring lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:10:56 user nova-compute[73091]: INFO nova.compute.manager [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Attaching volume 4f2c8637-83ca-4cd9-8e3e-d788145f604c to /dev/vdb
Aug 16 08:10:56 user nova-compute[73091]: DEBUG os_brick.utils [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[540408c4-ac21-4dcf-9d89-825be8526b19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ddb904-877c-469a-b3f0-7994214b6a79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.035s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fcdc68-0271-412d-abaf-657a7bf8e688]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b851657e-70f6-43d9-a5c7-2777091837fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:10:56 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:10:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06965d0-f1d8-41d1-a99b-40e894cfe79c]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG os_brick.utils [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:10:56 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Updating existing volume attachment record: 33a532a4-e320-47dd-b45f-4118f401313d {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:10:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:10:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-992a2bf0-4a15-4a3e-a5ff-28ccc4288613 req-7a267be0-d2b0-4f7f-a671-a831e2e99499 service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Received event network-changed-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:10:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-992a2bf0-4a15-4a3e-a5ff-28ccc4288613 req-7a267be0-d2b0-4f7f-a671-a831e2e99499 service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Refreshing instance network info cache due to event network-changed-d8ac0de6-d0c5-4599-88b7-2d6837852ff3. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:10:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-992a2bf0-4a15-4a3e-a5ff-28ccc4288613 req-7a267be0-d2b0-4f7f-a671-a831e2e99499 service nova] Acquiring lock "refresh_cache-a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:10:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-992a2bf0-4a15-4a3e-a5ff-28ccc4288613 req-7a267be0-d2b0-4f7f-a671-a831e2e99499 service nova] Acquired lock "refresh_cache-a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:10:59 user nova-compute[73091]: DEBUG nova.network.neutron [req-992a2bf0-4a15-4a3e-a5ff-28ccc4288613 req-7a267be0-d2b0-4f7f-a671-a831e2e99499 service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Refreshing network info cache for port d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lazy-loading 'flavor' on Instance uuid a7ae44fc-14fd-457c-8ae7-d8c65df6be2d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-9e393b73-5d82-4a1b-8a19-59b0199e7b9f req-7b12fc40-9df7-4d9e-a33c-1d6c0c857a1d service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-changed-484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-9e393b73-5d82-4a1b-8a19-59b0199e7b9f req-7b12fc40-9df7-4d9e-a33c-1d6c0c857a1d service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Refreshing instance network info cache due to event network-changed-484c8e2e-4293-41a9-af3c-a6ceb2221a66. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9e393b73-5d82-4a1b-8a19-59b0199e7b9f req-7b12fc40-9df7-4d9e-a33c-1d6c0c857a1d service nova] Acquiring lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9e393b73-5d82-4a1b-8a19-59b0199e7b9f req-7b12fc40-9df7-4d9e-a33c-1d6c0c857a1d service nova] Acquired lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG nova.network.neutron [req-9e393b73-5d82-4a1b-8a19-59b0199e7b9f req-7b12fc40-9df7-4d9e-a33c-1d6c0c857a1d service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Refreshing network info cache for port 484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:00 user nova-compute[73091]: INFO nova.compute.manager [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Attaching volume dbe64faf-342b-4840-9f5a-09057ec713ba to /dev/vdb
Aug 16 08:11:00 user nova-compute[73091]: DEBUG os_brick.utils [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6147731c-7ab4-4689-b575-a4554973d26e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.040s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc67590-247b-4cc7-b4fa-7f71ad770cee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e7a6be-bb85-4e11-93ec-6d5385d5e55e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cfc178-331f-4a41-b19b-36acd26e64b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:11:00 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe0d798-7b14-4e55-b2fc-c4654c474151]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG os_brick.utils [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Updating existing volume attachment record: 61c19eb7-bcf6-4837-8d94-ef9d6a8caea2 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquiring lock "interface-6060dcaf-e451-4308-b96f-43bcbf56d621-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "interface-6060dcaf-e451-4308-b96f-43bcbf56d621-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lazy-loading 'flavor' on Instance uuid 6060dcaf-e451-4308-b96f-43bcbf56d621 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "90ad75e0-f191-418b-a970-41fcfd500a77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "90ad75e0-f191-418b-a970-41fcfd500a77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG nova.objects.instance [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lazy-loading 'flavor' on Instance uuid 90ad75e0-f191-418b-a970-41fcfd500a77 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "90ad75e0-f191-418b-a970-41fcfd500a77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-992a2bf0-4a15-4a3e-a5ff-28ccc4288613 req-7a267be0-d2b0-4f7f-a671-a831e2e99499 service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Updated VIF entry in instance network info cache for port d8ac0de6-d0c5-4599-88b7-2d6837852ff3. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-992a2bf0-4a15-4a3e-a5ff-28ccc4288613 req-7a267be0-d2b0-4f7f-a671-a831e2e99499 service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Updating instance_info_cache with network_info: [{"id": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "address": "fa:16:3e:3d:e4:37", "network": {"id": "20265325-2c56-4e00-9ef1-bf5dccaab55a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-28492343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c313d283deb4669823af7dd855c24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac0de6-d0", "ovs_interfaceid": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-992a2bf0-4a15-4a3e-a5ff-28ccc4288613 req-7a267be0-d2b0-4f7f-a671-a831e2e99499 service nova] Releasing lock "refresh_cache-a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lazy-loading 'pci_requests' on Instance uuid 6060dcaf-e451-4308-b96f-43bcbf56d621 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "90ad75e0-f191-418b-a970-41fcfd500a77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "90ad75e0-f191-418b-a970-41fcfd500a77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:01 user nova-compute[73091]: INFO nova.compute.manager [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Attaching volume 788080d4-25ff-49f9-b223-eb5217d67dfd to /dev/sdc
Aug 16 08:11:01 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG os_brick.utils [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cc15ad-9b51-4d57-a71f-69baa8ba1307]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-9e393b73-5d82-4a1b-8a19-59b0199e7b9f req-7b12fc40-9df7-4d9e-a33c-1d6c0c857a1d service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Updated VIF entry in instance network info cache for port 484c8e2e-4293-41a9-af3c-a6ceb2221a66. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG nova.network.neutron [req-9e393b73-5d82-4a1b-8a19-59b0199e7b9f req-7b12fc40-9df7-4d9e-a33c-1d6c0c857a1d service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Updating instance_info_cache with network_info: [{"id": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "address": "fa:16:3e:43:ce:db", "network": {"id": "6fa0c4ff-1fbd-499d-ac02-362c7671c238", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-553465889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c8e2e-42", "ovs_interfaceid": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e971e5-21fa-4685-8f7f-8544b1705c87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG nova.policy [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3e5cf312ea947d7bd695bea3b892664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c792e3e04a0441459b54db9975a0b270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9e393b73-5d82-4a1b-8a19-59b0199e7b9f req-7b12fc40-9df7-4d9e-a33c-1d6c0c857a1d service nova] Releasing lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8555c6ad-670f-47b1-82c7-afed7e26ff16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8940eac1-9bcd-4ba2-a952-793a447bb571]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:11:01 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:11:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2526138a-a4a7-40ce-9dad-da94ef8dd942]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG os_brick.utils [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Updating existing volume attachment record: b169c02c-4a98-45ff-80c9-d059271ef7bc {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:11:01 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Successfully created port: 08daec2a-bf29-4d4d-ae4f-7305c9a38f6e {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:11:02 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Successfully updated port: 08daec2a-bf29-4d4d-ae4f-7305c9a38f6e {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:11:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquiring lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:11:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquired lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:11:02 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:11:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-2c241680-3370-4619-aeff-a5b90c03d584 req-b9a30b80-341f-4744-9e30-9a5b5ad41a46 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-changed-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:11:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-2c241680-3370-4619-aeff-a5b90c03d584 req-b9a30b80-341f-4744-9e30-9a5b5ad41a46 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Refreshing instance network info cache due to event network-changed-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:11:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2c241680-3370-4619-aeff-a5b90c03d584 req-b9a30b80-341f-4744-9e30-9a5b5ad41a46 service nova] Acquiring lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG nova.network.neutron [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Updating instance_info_cache with network_info: [{"id": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "address": "fa:16:3e:43:ce:db", "network": {"id": "6fa0c4ff-1fbd-499d-ac02-362c7671c238", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-553465889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c8e2e-42", "ovs_interfaceid": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "address": "fa:16:3e:38:41:7a", "network": {"id": "e3fef4ee-18c1-4e15-863d-d570b9d937ff", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1887518115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08daec2a-bf", "ovs_interfaceid": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Releasing lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2c241680-3370-4619-aeff-a5b90c03d584 req-b9a30b80-341f-4744-9e30-9a5b5ad41a46 service nova] Acquired lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG nova.network.neutron [req-2c241680-3370-4619-aeff-a5b90c03d584 req-b9a30b80-341f-4744-9e30-9a5b5ad41a46 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Refreshing network info cache for port 08daec2a-bf29-4d4d-ae4f-7305c9a38f6e {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-533383333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-533383333',id=8,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVA21kXfGbBZ8tCkmT8f3te1Beei+c1JBZA9yX2YdMqwQ7rOdytqAnah4ggCfCIOD5TJSFrM/TOy12XBf1vQaZu3PTuMiXP/NZi01CNr4OGI2WqEhw1bg2TvGRW+Q0clA==',key_name='tempest-keypair-944206026',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:09:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c792e3e04a0441459b54db9975a0b270',ramdisk_id='',reservation_id='r-0m5hrv3n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1641584847',owner_user_name='tempest-TaggedAttachmentsTest-1641584847-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3e5cf312ea947d7bd695bea3b892664',uuid=6060dcaf-e451-4308-b96f-43bcbf56d621,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "address": "fa:16:3e:38:41:7a", "network": {"id": "e3fef4ee-18c1-4e15-863d-d570b9d937ff", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1887518115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08daec2a-bf", "ovs_interfaceid": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Converting VIF {"id": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "address": "fa:16:3e:38:41:7a", "network": {"id": "e3fef4ee-18c1-4e15-863d-d570b9d937ff", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1887518115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08daec2a-bf", "ovs_interfaceid": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:41:7a,bridge_name='br-int',has_traffic_filtering=True,id=08daec2a-bf29-4d4d-ae4f-7305c9a38f6e,network=Network(e3fef4ee-18c1-4e15-863d-d570b9d937ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08daec2a-bf') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG os_vif [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:41:7a,bridge_name='br-int',has_traffic_filtering=True,id=08daec2a-bf29-4d4d-ae4f-7305c9a38f6e,network=Network(e3fef4ee-18c1-4e15-863d-d570b9d937ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08daec2a-bf') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08daec2a-bf, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08daec2a-bf, col_values=(('external_ids', {'iface-id': '08daec2a-bf29-4d4d-ae4f-7305c9a38f6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:41:7a', 'vm-uuid': '6060dcaf-e451-4308-b96f-43bcbf56d621'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:03 user nova-compute[73091]: INFO os_vif [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:41:7a,bridge_name='br-int',has_traffic_filtering=True,id=08daec2a-bf29-4d4d-ae4f-7305c9a38f6e,network=Network(e3fef4ee-18c1-4e15-863d-d570b9d937ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08daec2a-bf')
Aug 16 08:11:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-533383333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-533383333',id=8,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVA21kXfGbBZ8tCkmT8f3te1Beei+c1JBZA9yX2YdMqwQ7rOdytqAnah4ggCfCIOD5TJSFrM/TOy12XBf1vQaZu3PTuMiXP/NZi01CNr4OGI2WqEhw1bg2TvGRW+Q0clA==',key_name='tempest-keypair-944206026',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:09:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c792e3e04a0441459b54db9975a0b270',ramdisk_id='',reservation_id='r-0m5hrv3n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1641584847',owner_user_name='tempest-TaggedAttachmentsTest-1641584847-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3e5cf312ea947d7bd695bea3b892664',uuid=6060dcaf-e451-4308-b96f-43bcbf56d621,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "address": "fa:16:3e:38:41:7a", "network": {"id": "e3fef4ee-18c1-4e15-863d-d570b9d937ff", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1887518115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08daec2a-bf", "ovs_interfaceid": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Converting VIF {"id": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "address": "fa:16:3e:38:41:7a", "network": {"id": "e3fef4ee-18c1-4e15-863d-d570b9d937ff", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1887518115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08daec2a-bf", "ovs_interfaceid": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:41:7a,bridge_name='br-int',has_traffic_filtering=True,id=08daec2a-bf29-4d4d-ae4f-7305c9a38f6e,network=Network(e3fef4ee-18c1-4e15-863d-d570b9d937ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08daec2a-bf') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] attach device xml: <interface type="ethernet">
Aug 16 08:11:03 user nova-compute[73091]:   <mac address="fa:16:3e:38:41:7a"/>
Aug 16 08:11:03 user nova-compute[73091]:   <model type="virtio"/>
Aug 16 08:11:03 user nova-compute[73091]:   <mtu size="1442"/>
Aug 16 08:11:03 user nova-compute[73091]:   <target dev="tap08daec2a-bf"/>
Aug 16 08:11:03 user nova-compute[73091]: </interface>
Aug 16 08:11:03 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-d1d24b0a-8ed6-4a52-8516-55d895098bc3 req-bfdad1f3-7a4f-4aaf-97ad-ff59af02090e service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-vif-plugged-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d1d24b0a-8ed6-4a52-8516-55d895098bc3 req-bfdad1f3-7a4f-4aaf-97ad-ff59af02090e service nova] Acquiring lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d1d24b0a-8ed6-4a52-8516-55d895098bc3 req-bfdad1f3-7a4f-4aaf-97ad-ff59af02090e service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d1d24b0a-8ed6-4a52-8516-55d895098bc3 req-bfdad1f3-7a4f-4aaf-97ad-ff59af02090e service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-d1d24b0a-8ed6-4a52-8516-55d895098bc3 req-bfdad1f3-7a4f-4aaf-97ad-ff59af02090e service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] No waiting events found dispatching network-vif-plugged-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:11:03 user nova-compute[73091]: WARNING nova.compute.manager [req-d1d24b0a-8ed6-4a52-8516-55d895098bc3 req-bfdad1f3-7a4f-4aaf-97ad-ff59af02090e service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received unexpected event network-vif-plugged-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e for instance with vm_state active and task_state None.
Aug 16 08:11:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG nova.network.neutron [req-2c241680-3370-4619-aeff-a5b90c03d584 req-b9a30b80-341f-4744-9e30-9a5b5ad41a46 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Updated VIF entry in instance network info cache for port 08daec2a-bf29-4d4d-ae4f-7305c9a38f6e. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG nova.network.neutron [req-2c241680-3370-4619-aeff-a5b90c03d584 req-b9a30b80-341f-4744-9e30-9a5b5ad41a46 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Updating instance_info_cache with network_info: [{"id": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "address": "fa:16:3e:43:ce:db", "network": {"id": "6fa0c4ff-1fbd-499d-ac02-362c7671c238", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-553465889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c8e2e-42", "ovs_interfaceid": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "address": "fa:16:3e:38:41:7a", "network": {"id": "e3fef4ee-18c1-4e15-863d-d570b9d937ff", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1887518115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08daec2a-bf", "ovs_interfaceid": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:11:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2c241680-3370-4619-aeff-a5b90c03d584 req-b9a30b80-341f-4744-9e30-9a5b5ad41a46 service nova] Releasing lock "refresh_cache-6060dcaf-e451-4308-b96f-43bcbf56d621" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:11:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:11:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] No BDM found with device name hda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:11:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] No VIF found with MAC fa:16:3e:43:ce:db, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:11:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:11:04 user nova-compute[73091]:   <nova:package version="0.0.0"/>
Aug 16 08:11:04 user nova-compute[73091]:   <nova:name>tempest-device-tagging-server-533383333</nova:name>
Aug 16 08:11:04 user nova-compute[73091]:   <nova:creationTime>2023-08-16 08:11:04</nova:creationTime>
Aug 16 08:11:04 user nova-compute[73091]:   <nova:flavor name="m1.tiny">
Aug 16 08:11:04 user nova-compute[73091]:     <nova:memory>512</nova:memory>
Aug 16 08:11:04 user nova-compute[73091]:     <nova:disk>1</nova:disk>
Aug 16 08:11:04 user nova-compute[73091]:     <nova:swap>0</nova:swap>
Aug 16 08:11:04 user nova-compute[73091]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:11:04 user nova-compute[73091]:     <nova:vcpus>1</nova:vcpus>
Aug 16 08:11:04 user nova-compute[73091]:   </nova:flavor>
Aug 16 08:11:04 user nova-compute[73091]:   <nova:owner>
Aug 16 08:11:04 user nova-compute[73091]:     <nova:user uuid="d3e5cf312ea947d7bd695bea3b892664">tempest-TaggedAttachmentsTest-1641584847-project-member</nova:user>
Aug 16 08:11:04 user nova-compute[73091]:     <nova:project uuid="c792e3e04a0441459b54db9975a0b270">tempest-TaggedAttachmentsTest-1641584847</nova:project>
Aug 16 08:11:04 user nova-compute[73091]:   </nova:owner>
Aug 16 08:11:04 user nova-compute[73091]:   <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:11:04 user nova-compute[73091]:   <nova:ports>
Aug 16 08:11:04 user nova-compute[73091]:     <nova:port uuid="484c8e2e-4293-41a9-af3c-a6ceb2221a66">
Aug 16 08:11:04 user nova-compute[73091]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 08:11:04 user nova-compute[73091]:     </nova:port>
Aug 16 08:11:04 user nova-compute[73091]:     <nova:port uuid="08daec2a-bf29-4d4d-ae4f-7305c9a38f6e">
Aug 16 08:11:04 user nova-compute[73091]:       <nova:ip type="fixed" address="10.10.10.139" ipVersion="4"/>
Aug 16 08:11:04 user nova-compute[73091]:     </nova:port>
Aug 16 08:11:04 user nova-compute[73091]:   </nova:ports>
Aug 16 08:11:04 user nova-compute[73091]: </nova:instance>
Aug 16 08:11:04 user nova-compute[73091]:  {{(pid=73091) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 08:11:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2d209946-a349-4538-96ff-41d29d34be5f tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "interface-6060dcaf-e451-4308-b96f-43bcbf56d621-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.517s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-04201918-8e10-40f0-92a6-b3f7b7ae1e91 req-773eecd1-cabf-4857-bd4d-7ce5c0093062 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received event network-changed-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:11:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-04201918-8e10-40f0-92a6-b3f7b7ae1e91 req-773eecd1-cabf-4857-bd4d-7ce5c0093062 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Refreshing instance network info cache due to event network-changed-ff7593ef-acd3-4f60-8f85-e4314751d437. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04201918-8e10-40f0-92a6-b3f7b7ae1e91 req-773eecd1-cabf-4857-bd4d-7ce5c0093062 service nova] Acquiring lock "refresh_cache-58fb6a40-f818-4515-be92-9f5dd96e40d6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04201918-8e10-40f0-92a6-b3f7b7ae1e91 req-773eecd1-cabf-4857-bd4d-7ce5c0093062 service nova] Acquired lock "refresh_cache-58fb6a40-f818-4515-be92-9f5dd96e40d6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:11:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-04201918-8e10-40f0-92a6-b3f7b7ae1e91 req-773eecd1-cabf-4857-bd4d-7ce5c0093062 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Refreshing network info cache for port ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:11:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-04201918-8e10-40f0-92a6-b3f7b7ae1e91 req-773eecd1-cabf-4857-bd4d-7ce5c0093062 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Updated VIF entry in instance network info cache for port ff7593ef-acd3-4f60-8f85-e4314751d437. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:11:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-04201918-8e10-40f0-92a6-b3f7b7ae1e91 req-773eecd1-cabf-4857-bd4d-7ce5c0093062 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Updating instance_info_cache with network_info: [{"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04201918-8e10-40f0-92a6-b3f7b7ae1e91 req-773eecd1-cabf-4857-bd4d-7ce5c0093062 service nova] Releasing lock "refresh_cache-58fb6a40-f818-4515-be92-9f5dd96e40d6" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:11:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-15f51ba7-d8c6-40ed-b12e-e001724c67bd req-59811481-6f37-4267-9564-09aaaca8159e service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-vif-plugged-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15f51ba7-d8c6-40ed-b12e-e001724c67bd req-59811481-6f37-4267-9564-09aaaca8159e service nova] Acquiring lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15f51ba7-d8c6-40ed-b12e-e001724c67bd req-59811481-6f37-4267-9564-09aaaca8159e service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-15f51ba7-d8c6-40ed-b12e-e001724c67bd req-59811481-6f37-4267-9564-09aaaca8159e service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-15f51ba7-d8c6-40ed-b12e-e001724c67bd req-59811481-6f37-4267-9564-09aaaca8159e service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] No waiting events found dispatching network-vif-plugged-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:11:05 user nova-compute[73091]: WARNING nova.compute.manager [req-15f51ba7-d8c6-40ed-b12e-e001724c67bd req-59811481-6f37-4267-9564-09aaaca8159e service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received unexpected event network-vif-plugged-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e for instance with vm_state active and task_state None.
Aug 16 08:11:07 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaXBeJSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:07 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:07 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:07 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ec2d5e-3050-47ba-a995-8fb7a8f0c166]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:11:07 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19b8055-1cae-455c-a8f7-b1de5535a10f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c] added
Aug 16 08:11:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[870b0a6d-e203-404d-b827-a7843cb77743]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb34589-c774-46be-95e1-5bb364e47653]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OaXBeJSC {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OaXBeJSC" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1d0444-aa0b-46f7-98df-ddda8f069571]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OaXBeJSC'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f36a77e-5082-4a91-81fe-b5fd463a6855]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[44754907-ca9e-4dd7-9188-f1e40d8b8c9e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquiring lock "6060dcaf-e451-4308-b96f-43bcbf56d621" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG nova.objects.instance [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lazy-loading 'flavor' on Instance uuid 6060dcaf-e451-4308-b96f-43bcbf56d621 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fba6d9-05fe-40b0-b3b1-e83cbad4ac0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c, portal: 172.16.0.220,3260]
Aug 16 08:11:07 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c, portal: 172.16.0.220,3260] successful.
Aug 16 08:11:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1620fb36-6a5d-4b92-9294-f1804c9c92bd]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd1fe20-033d-4e0a-ad56-07d89130450c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:07 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:07 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58c44f8-12b4-4005-9e44-0d947de60aba]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:11:07 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaXBeJSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquiring lock "6060dcaf-e451-4308-b96f-43bcbf56d621" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:08 user nova-compute[73091]: INFO nova.compute.manager [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Attaching volume bf75c4c9-45e3-4389-8e75-2d6e2d56da2a to /dev/vdb
Aug 16 08:11:08 user nova-compute[73091]: DEBUG os_brick.utils [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25d889f-a3d8-43d2-9b20-fdc627eaa234]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aecb5fb-8830-4dac-a0e7-b978654d36ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceacd233-87bf-4774-873c-9e7a63873d88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1c8095-0426-4752-9a0c-21bb04c15925]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:11:08 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:11:08 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16e0bce-5cd1-4673-87da-6114d4584f3f]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG os_brick.utils [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Updating existing volume attachment record: 95863dd4-04e5-4b06-a440-7dbacfcb92d8 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:08 user nova-compute[73091]: INFO nova.compute.manager [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Rebuilding instance
Aug 16 08:11:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lazy-loading 'trusted_certs' on Instance uuid 58fb6a40-f818-4515-be92-9f5dd96e40d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lazy-loading 'pci_requests' on Instance uuid 58fb6a40-f818-4515-be92-9f5dd96e40d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lazy-loading 'pci_devices' on Instance uuid 58fb6a40-f818-4515-be92-9f5dd96e40d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26134633664363037', 'path': '/dev/sdi'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134633664363037', 'path': '/dev/sdi'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lazy-loading 'resources' on Instance uuid 58fb6a40-f818-4515-be92-9f5dd96e40d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lazy-loading 'flavor' on Instance uuid b4e06e3b-5389-4054-aa47-d9cf7b638c0f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lazy-loading 'migration_context' on Instance uuid 58fb6a40-f818-4515-be92-9f5dd96e40d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73091) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 08:11:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] attach device xml: <disk type="block" device="disk">
Aug 16 08:11:09 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:11:09 user nova-compute[73091]:   <source dev="/dev/sdi"/>
Aug 16 08:11:09 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:11:09 user nova-compute[73091]:   <serial>4f2c8637-83ca-4cd9-8e3e-d788145f604c</serial>
Aug 16 08:11:09 user nova-compute[73091]: </disk>
Aug 16 08:11:09 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 08:11:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-0433b7ba-789d-4df4-b6d8-dcf54c8d6af7 req-f77e1e87-3091-467b-93ed-e94b9fd5aed9 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received event network-vif-unplugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:11:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0433b7ba-789d-4df4-b6d8-dcf54c8d6af7 req-f77e1e87-3091-467b-93ed-e94b9fd5aed9 service nova] Acquiring lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0433b7ba-789d-4df4-b6d8-dcf54c8d6af7 req-f77e1e87-3091-467b-93ed-e94b9fd5aed9 service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0433b7ba-789d-4df4-b6d8-dcf54c8d6af7 req-f77e1e87-3091-467b-93ed-e94b9fd5aed9 service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-0433b7ba-789d-4df4-b6d8-dcf54c8d6af7 req-f77e1e87-3091-467b-93ed-e94b9fd5aed9 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] No waiting events found dispatching network-vif-unplugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:11:09 user nova-compute[73091]: WARNING nova.compute.manager [req-0433b7ba-789d-4df4-b6d8-dcf54c8d6af7 req-f77e1e87-3091-467b-93ed-e94b9fd5aed9 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received unexpected event network-vif-unplugged-ff7593ef-acd3-4f60-8f85-e4314751d437 for instance with vm_state active and task_state rebuilding.
Aug 16 08:11:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:11:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:11:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] No VIF found with MAC fa:16:3e:a4:45:19, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:11:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Instance destroyed successfully.
Aug 16 08:11:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Instance destroyed successfully.
Aug 16 08:11:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-161383938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-622705224',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgwr+lPrpEP5o9ETv2V1lYpdSx5+1jSfz5g40qSuKvSXhEDtmL9vrp71E/TIr7O7WlZ5kcRETw3PrK7xu+z/FUuEGZhJeo4ndVNxGCXeTwKuExSPw6ICDcnszQlQ44bDg==',key_name='tempest-keypair-1739562332',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:09:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3cd0afcf7cd4d06b6914fd69282e6df',ramdisk_id='',reservation_id='r-j2kcg45t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1659459997',owner_user_name='tempest-ServerActionsV293TestJSON-1659459997-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:11:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb81b27063f549ab938bea843a3ed7c6',uuid=58fb6a40-f818-4515-be92-9f5dd96e40d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Converting VIF {"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:e5:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff7593ef-acd3-4f60-8f85-e4314751d437,network=Network(38194120-0573-40dd-a8f9-78e2afcb9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7593ef-ac') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_vif [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:e5:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff7593ef-acd3-4f60-8f85-e4314751d437,network=Network(38194120-0573-40dd-a8f9-78e2afcb9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7593ef-ac') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff7593ef-ac, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:11:10 user nova-compute[73091]: INFO os_vif [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:e5:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff7593ef-acd3-4f60-8f85-e4314751d437,network=Network(38194120-0573-40dd-a8f9-78e2afcb9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7593ef-ac')
Aug 16 08:11:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWKlGuEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:10 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[739b139a-8f89-4b18-9a82-4bb0a8ef0134]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8507e5-4024-48d6-a95b-fa63ffd3a5b0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:10 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:10 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:10 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:10 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:10 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:10 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:10 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:10 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:10 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:10 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:10 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:10 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:10 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:10 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8f069ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d96dd30-4c81-4be6-98ec-40b99664929c]: (4, ('path checker states:\nup                  6\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f1a6b5-47fa-45bd-a98c-a2c136a29887]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[489482ab-5d1d-4146-ae89-5695dc67702f]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[031b1c71-0d59-4b95-8e0c-5a3df214efb5]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2d9ebef6', '/dev/disk/by-id/scsi-1SCST_BIO2d9ebef6-d98588e9d2bbaef6', '/dev/disk/by-id/scsi-26439383538386539') {{(pid=83685) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e13377-6e6e-44c5-9a20-f9ee4869f73c]: (4, None) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4e9355-cf3b-4c1a-9847-bd53601a791d]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[64888339-90d9-462f-956b-9a998a2e3a83]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260]
Aug 16 08:11:10 user nova-compute[73091]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260] successful.
Aug 16 08:11:10 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88b1b74-4c93-473a-bc4d-6aeaab403f1f]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] <== disconnect_volume: return (356ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:11:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Deleting instance files /opt/stack/data/nova/instances/58fb6a40-f818-4515-be92-9f5dd96e40d6_del
Aug 16 08:11:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Deletion of /opt/stack/data/nova/instances/58fb6a40-f818-4515-be92-9f5dd96e40d6_del complete
Aug 16 08:11:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJioywhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:11 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:11 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:11 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[07189396-01be-49f1-b0b9-6b79ee90867b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:11:11 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfd05c4-be86-4a78-810b-90402ace116e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba] added
Aug 16 08:11:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e204348c-f8f4-417e-aaa7-1abb161dd30a]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39d9701-7186-472b-8df4-11a192e3ad6c]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJioywhZ {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJioywhZ" returned: 0 in 0.028s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec16ea0-44f9-45f9-9b87-1d290b4283a9]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QJioywhZ'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29f31e6-7ac6-497e-b422-bb7a74a683ad]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c65229-b035-4927-8fd7-dfeff40ccc7b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-c5c3a55d-c995-4540-b056-dd2f4b967440 req-f69051e2-8f9d-4844-a514-4a8577172cdf service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received event network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c5c3a55d-c995-4540-b056-dd2f4b967440 req-f69051e2-8f9d-4844-a514-4a8577172cdf service nova] Acquiring lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c5c3a55d-c995-4540-b056-dd2f4b967440 req-f69051e2-8f9d-4844-a514-4a8577172cdf service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c5c3a55d-c995-4540-b056-dd2f4b967440 req-f69051e2-8f9d-4844-a514-4a8577172cdf service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-c5c3a55d-c995-4540-b056-dd2f4b967440 req-f69051e2-8f9d-4844-a514-4a8577172cdf service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] No waiting events found dispatching network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:11:11 user nova-compute[73091]: WARNING nova.compute.manager [req-c5c3a55d-c995-4540-b056-dd2f4b967440 req-f69051e2-8f9d-4844-a514-4a8577172cdf service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received unexpected event network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 for instance with vm_state active and task_state rebuilding.
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd932000-43c7-46e1-b769-abd59ec4fad4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260]
Aug 16 08:11:11 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260] successful.
Aug 16 08:11:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadbbdb9-4cc2-4368-b37d-704b2139c29a]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-052677c8-e0ef-4271-8028-5085e2502fd7 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.392s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5497294-1bab-4f3b-bbc6-1ef4b658efa0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:11 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:11 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87a5989-c3f5-4079-8ad6-4b526963ffab]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJioywhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:11:11 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 58fb6a40-f818-4515-be92-9f5dd96e40d6 could not be found.
Aug 16 08:11:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWKlGuEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:11 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 08:11:11 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxNHRrIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:12 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26262386563346435', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262386563346435', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.926s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lazy-loading 'flavor' on Instance uuid a7ae44fc-14fd-457c-8ae7-d8c65df6be2d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa911770-a0b6-412f-965f-f77ae1a05dea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 08:11:12 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:11:12 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 08:11:12 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:11:12 user nova-compute[73091]:   <serial>dbe64faf-342b-4840-9f5a-09057ec713ba</serial>
Aug 16 08:11:12 user nova-compute[73091]: </disk>
Aug 16 08:11:12 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94665273-5f5f-4040-a921-a61aac7b859d tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] volume_snapshot_create: create_info: {'snapshot_id': 'ac062315-652e-4cd7-8b6f-094640426744', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73091) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32841cb-2e82-4e42-8b96-ea9197ddd835]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:12 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:12 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:12 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:12 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:12 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:12 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:12 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:12 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:12 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:12 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:12 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:12 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:12 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:12 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb904a0e200>, {}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Disconnecting from: [] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] <== disconnect_volume: return (1001ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.280s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:12 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:12 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94665273-5f5f-4040-a921-a61aac7b859d tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] snap xml: <domainsnapshot>
Aug 16 08:11:12 user nova-compute[73091]:   <disks>
Aug 16 08:11:12 user nova-compute[73091]:     <disk name="/dev/sdi" snapshot="external" type="file">
Aug 16 08:11:12 user nova-compute[73091]:       <source file="/dev/new_file"/>
Aug 16 08:11:12 user nova-compute[73091]:     </disk>
Aug 16 08:11:12 user nova-compute[73091]:     <disk name="vda" snapshot="no"/>
Aug 16 08:11:12 user nova-compute[73091]:   </disks>
Aug 16 08:11:12 user nova-compute[73091]: </domainsnapshot>
Aug 16 08:11:12 user nova-compute[73091]:  {{(pid=73091) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG nova.objects.instance [None req-94665273-5f5f-4040-a921-a61aac7b859d tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lazy-loading 'system_metadata' on Instance uuid b4e06e3b-5389-4054-aa47-d9cf7b638c0f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[520bb1c9-e28f-43d9-bf48-9abcc03c2281]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:11:12 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c814f54f-b06a-4bc5-95ea-b85d93d02c27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd] added
Aug 16 08:11:12 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-94665273-5f5f-4040-a921-a61aac7b859d tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[626f1419-0d0f-45a2-8165-ba67c9dbc544]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-94665273-5f5f-4040-a921-a61aac7b859d tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Traceback (most recent call last):
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     rv = execute(f, *args, **kwargs)
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     six.reraise(c, e, tb)
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     raise value
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     rv = meth(*args, **kwargs)
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] 
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-94665273-5f5f-4040-a921-a61aac7b859d tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Traceback (most recent call last):
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     self._volume_snapshot_create(context, instance, guest,
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     rv = execute(f, *args, **kwargs)
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     six.reraise(c, e, tb)
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     raise value
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     rv = meth(*args, **kwargs)
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] 
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a054c4cf-e4d9-44e8-83c5-f3372dd6a3c5 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] volume_snapshot_delete: delete_info: {'volume_id': '4f2c8637-83ca-4cd9-8e3e-d788145f604c'} {{(pid=73091) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-a054c4cf-e4d9-44e8-83c5-f3372dd6a3c5 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Traceback (most recent call last):
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f]     if delete_info['type'] != 'qcow2':
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] KeyError: 'type'
Aug 16 08:11:12 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] 
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78f5900-13c1-4059-9180-3739f2d92a4c]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:12 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxNHRrIC {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxNHRrIC" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2009fe-0765-467a-a539-6b56401a22bc]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wxNHRrIC'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0417b9-873a-4414-991d-936f1153b390]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-94665273-5f5f-4040-a921-a61aac7b859d tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot ac062315-652e-4cd7-8b6f-094640426744 could not be found.
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise value
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot ac062315-652e-4cd7-8b6f-094640426744 could not be found. (HTTP 404) (Request-ID: req-63544327-724c-4aa4-b9d1-c7dc808e29c8)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot ac062315-652e-4cd7-8b6f-094640426744 could not be found.
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2f0ff0-ed9d-42f1-aef3-cdec5f8f304d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server [None req-94665273-5f5f-4040-a921-a61aac7b859d tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise value
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server 
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde41e6f-e7f6-4e4a-a13b-abbf1f534304]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd, portal: 172.16.0.220,3260]
Aug 16 08:11:13 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd, portal: 172.16.0.220,3260] successful.
Aug 16 08:11:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3b3fde-19bc-4628-9fe7-880a491d8568]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff0e287-ffab-4cf1-8f67-954585dd6471]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:13 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:13 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver [None req-a054c4cf-e4d9-44e8-83c5-f3372dd6a3c5 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-24ae889b-c834-44e9-bac7-d293c14f1942)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 08:11:13 user nova-compute[73091]: ERROR nova.virt.libvirt.driver 
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server [None req-a054c4cf-e4d9-44e8-83c5-f3372dd6a3c5 tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Exception during message handling: KeyError: 'type'
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 16 08:11:13 user nova-compute[73091]: ERROR oslo_messaging.rpc.server 
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbbcfb8-e3f2-4b8d-9774-d1f845b20289]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxNHRrIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] No VIF found with MAC fa:16:3e:3d:e4:37, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f9b45168-9c03-41ca-96c4-9817f6f1d043 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.302s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Acquiring lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:13 user nova-compute[73091]: INFO nova.compute.manager [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Detaching volume 4f2c8637-83ca-4cd9-8e3e-d788145f604c
Aug 16 08:11:13 user nova-compute[73091]: INFO nova.virt.block_device [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Attempting to driver detach volume 4f2c8637-83ca-4cd9-8e3e-d788145f604c from mountpoint /dev/vdb
Aug 16 08:11:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Attempting to detach device vdb from instance b4e06e3b-5389-4054-aa47-d9cf7b638c0f from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 08:11:13 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:11:13 user nova-compute[73091]:   <source dev="/dev/sdi"/>
Aug 16 08:11:13 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:11:13 user nova-compute[73091]:   <serial>4f2c8637-83ca-4cd9-8e3e-d788145f604c</serial>
Aug 16 08:11:13 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 08:11:13 user nova-compute[73091]: </disk>
Aug 16 08:11:13 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:13 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Successfully detached device vdb from instance b4e06e3b-5389-4054-aa47-d9cf7b638c0f from the persistent domain config.
Aug 16 08:11:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b4e06e3b-5389-4054-aa47-d9cf7b638c0f from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 08:11:13 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 08:11:13 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:11:13 user nova-compute[73091]:   <source dev="/dev/sdi"/>
Aug 16 08:11:13 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:11:13 user nova-compute[73091]:   <serial>4f2c8637-83ca-4cd9-8e3e-d788145f604c</serial>
Aug 16 08:11:13 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 08:11:13 user nova-compute[73091]: </disk>
Aug 16 08:11:13 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Preparing to wait for external event volume-reimaged-2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 {{(pid=73091) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] <== connect_volume: return (1771ms) {'type': 'block', 'scsi_wwn': '23265396463616334', 'path': '/dev/sdj'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265396463616334', 'path': '/dev/sdj'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lazy-loading 'flavor' on Instance uuid 90ad75e0-f191-418b-a970-41fcfd500a77 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 08:11:14 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:11:14 user nova-compute[73091]:   <source dev="/dev/sdj"/>
Aug 16 08:11:14 user nova-compute[73091]:   <target dev="sdc" bus="scsi"/>
Aug 16 08:11:14 user nova-compute[73091]:   <serial>788080d4-25ff-49f9-b223-eb5217d67dfd</serial>
Aug 16 08:11:14 user nova-compute[73091]:   <address type="drive" controller="0" unit="2"/>
Aug 16 08:11:14 user nova-compute[73091]: </disk>
Aug 16 08:11:14 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Received event <DeviceRemovedEvent: 1692173474.6080608, b4e06e3b-5389-4054-aa47-d9cf7b638c0f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b4e06e3b-5389-4054-aa47-d9cf7b638c0f {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 08:11:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Successfully detached device vdb from instance b4e06e3b-5389-4054-aa47-d9cf7b638c0f from the live domain config.
Aug 16 08:11:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OaXBeJSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:14 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.volume.cinder [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Update attachment failed for attachment 95863dd4-04e5-4b06-a440-7dbacfcb92d8. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:bf75c4c9-45e3-4389-8e75-2d6e2d56da2a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:bf75c4c9-45e3-4389-8e75-2d6e2d56da2a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 was not found.).). (HTTP 500) (Request-ID: req-43690226-25f6-4db5-a6e6-24fe59f80722) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:bf75c4c9-45e3-4389-8e75-2d6e2d56da2a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:bf75c4c9-45e3-4389-8e75-2d6e2d56da2a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 was not found.).). (HTTP 500) (Request-ID: req-43690226-25f6-4db5-a6e6-24fe59f80722)
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c363ba-322a-479c-a9de-7524bbf6759d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Failed to attach bf75c4c9-45e3-4389-8e75-2d6e2d56da2a at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:bf75c4c9-45e3-4389-8e75-2d6e2d56da2a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:bf75c4c9-45e3-4389-8e75-2d6e2d56da2a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 was not found.).). (HTTP 500) (Request-ID: req-43690226-25f6-4db5-a6e6-24fe59f80722)
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Traceback (most recent call last):
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     ret_val = method(obj, context, *args, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     self._do_attach(context, instance, volume, volume_api,
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     self._volume_attach(context, volume, connector, instance,
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     connection_info = volume_api.attachment_update(
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     res = method(self, ctx, *args, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     with excutils.save_and_reraise_exception():
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     self.force_reraise()
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     raise self.value
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     return method.func(obj, *args, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     resp = self._update('/attachments/%s' % id, body)
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     return self.request(url, method, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621]     raise exceptions.from_response(resp, body)
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:bf75c4c9-45e3-4389-8e75-2d6e2d56da2a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:bf75c4c9-45e3-4389-8e75-2d6e2d56da2a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 was not found.).). (HTTP 500) (Request-ID: req-43690226-25f6-4db5-a6e6-24fe59f80722)
Aug 16 08:11:14 user nova-compute[73091]: ERROR nova.compute.manager [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] 
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c414fba9-b9c3-4666-8785-a3a05595a874]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:14 user nova-compute[73091]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c (non-flash)
Aug 16 08:11:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8cc6f4700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c'): ({'sdi'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Removing single pathed devices sdi {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b041198c-ea48-44a6-aa2a-6aeaf1b3dae1]: (4, ('path checker states:\nup                  7\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[831b1730-0eeb-4664-9955-beb610782b19]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Flushing IO for device /dev/sdi {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.735s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6693597a-354f-49e5-b891-d25b32c4c61a]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[38512583-aa19-43f7-93cd-4f4aadbe3cae]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] SCSI volumes sdi have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server [None req-69ca9de1-292b-4e96-810d-3f68815d57e0 tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:bf75c4c9-45e3-4389-8e75-2d6e2d56da2a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:bf75c4c9-45e3-4389-8e75-2d6e2d56da2a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 was not found.).). (HTTP 500) (Request-ID: req-43690226-25f6-4db5-a6e6-24fe59f80722)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:bf75c4c9-45e3-4389-8e75-2d6e2d56da2a because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:bf75c4c9-45e3-4389-8e75-2d6e2d56da2a/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 was not found.).). (HTTP 500) (Request-ID: req-43690226-25f6-4db5-a6e6-24fe59f80722)
Aug 16 08:11:14 user nova-compute[73091]: ERROR oslo_messaging.rpc.server 
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba95c867-048a-4aa4-b289-885c6a96667d]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Acquiring lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.utils [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d92ebe-e757-4f3b-8251-71031346b1f4]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c, portal: 172.16.0.220,3260]
Aug 16 08:11:14 user nova-compute[73091]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c, portal: 172.16.0.220,3260] successful.
Aug 16 08:11:14 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c934ba22-15cc-4e44-ad27-36fd6fe4a592]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a08b52-768e-449c-a05c-5a93ee2c4b69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84bbac2-4e22-4786-8f52-5ea478bcf4dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2c8637-83ca-4cd9-8e3e-d788145f604c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[521b5c45-6e22-479a-938f-711ba7db4c7f]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] <== disconnect_volume: return (382ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd49936-e59e-4ca5-8f1e-d499e1f095f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:11:15 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:11:15 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[243164b8-294c-4226-8b48-c91f1d843015]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG os_brick.utils [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] No BDM found with device name sda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] No VIF found with MAC fa:16:3e:e1:6f:45, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:11:15 user nova-compute[73091]: INFO nova.compute.manager [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Swapping volume dbe64faf-342b-4840-9f5a-09057ec713ba for be32be16-adad-4bed-bb5c-8ce1ecdbec58
Aug 16 08:11:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eccce79b-473d-4121-85b6-551456cff8fa tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "90ad75e0-f191-418b-a970-41fcfd500a77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.218s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lazy-loading 'flavor' on Instance uuid b4e06e3b-5389-4054-aa47-d9cf7b638c0f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2da89109-9770-43fa-889e-6cf10e03599c tempest-VolumesAssistedSnapshotsTest-1767765498 tempest-VolumesAssistedSnapshotsTest-1767765498-project-admin] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.243s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "90ad75e0-f191-418b-a970-41fcfd500a77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "90ad75e0-f191-418b-a970-41fcfd500a77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:16 user nova-compute[73091]: INFO nova.compute.manager [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Detaching volume 788080d4-25ff-49f9-b223-eb5217d67dfd
Aug 16 08:11:16 user nova-compute[73091]: INFO nova.virt.block_device [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Attempting to driver detach volume 788080d4-25ff-49f9-b223-eb5217d67dfd from mountpoint /dev/sdc
Aug 16 08:11:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Attempting to detach device sdc from instance 90ad75e0-f191-418b-a970-41fcfd500a77 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:11:16 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:11:16 user nova-compute[73091]:   <source dev="/dev/sdj"/>
Aug 16 08:11:16 user nova-compute[73091]:   <target dev="sdc" bus="scsi"/>
Aug 16 08:11:16 user nova-compute[73091]:   <serial>788080d4-25ff-49f9-b223-eb5217d67dfd</serial>
Aug 16 08:11:16 user nova-compute[73091]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 08:11:16 user nova-compute[73091]: </disk>
Aug 16 08:11:16 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:11:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Successfully detached device sdc from instance 90ad75e0-f191-418b-a970-41fcfd500a77 from the persistent domain config.
Aug 16 08:11:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 90ad75e0-f191-418b-a970-41fcfd500a77 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:11:16 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:11:16 user nova-compute[73091]:   <source dev="/dev/sdj"/>
Aug 16 08:11:16 user nova-compute[73091]:   <target dev="sdc" bus="scsi"/>
Aug 16 08:11:16 user nova-compute[73091]:   <serial>788080d4-25ff-49f9-b223-eb5217d67dfd</serial>
Aug 16 08:11:16 user nova-compute[73091]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 08:11:16 user nova-compute[73091]: </disk>
Aug 16 08:11:16 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Received event <DeviceRemovedEvent: 1692173476.8425143, 90ad75e0-f191-418b-a970-41fcfd500a77 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 90ad75e0-f191-418b-a970-41fcfd500a77 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 08:11:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Successfully detached device sdc from instance 90ad75e0-f191-418b-a970-41fcfd500a77 from the live domain config.
Aug 16 08:11:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxNHRrIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:16 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0c6f47-d8b7-4119-9711-1c2bf1e5d78d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe57108a-0e4d-4921-8840-de14d7455f34]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:16 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd (non-flash)
Aug 16 08:11:16 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:16 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:16 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:16 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:16 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:16 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:16 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:16 user nova-compute[73091]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd (non-flash)
Aug 16 08:11:16 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:16 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:16 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:16 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:16 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:16 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:16 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8cc772dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd'): ({'sdj'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Removing single pathed devices sdj {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b762ff2d-f358-44c8-8ff6-4a0897b1dab2]: (4, ('path checker states:\nup                  6\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0045d02f-d443-462b-bc92-264ff68ad511]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Flushing IO for device /dev/sdj {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2918e49-6c25-414f-b229-dd0f643e1d8e]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:11:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.041s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9935f5-85fa-491d-b3e4-7e154156062c]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] SCSI volumes sdj have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcff8f49-e756-4621-8b91-81ca6dd574a6]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[27376bc4-789b-4038-99e8-1da2c95b8e1e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd, portal: 172.16.0.220,3260]
Aug 16 08:11:17 user nova-compute[73091]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd, portal: 172.16.0.220,3260] successful.
Aug 16 08:11:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:788080d4-25ff-49f9-b223-eb5217d67dfd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d5b043-8c5e-4c2e-944d-eaeb6cfac764]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] <== disconnect_volume: return (329ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG nova.objects.instance [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lazy-loading 'flavor' on Instance uuid 90ad75e0-f191-418b-a970-41fcfd500a77 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-694b9968-c790-490a-980f-a343bb4b2593 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "90ad75e0-f191-418b-a970-41fcfd500a77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.638s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "90ad75e0-f191-418b-a970-41fcfd500a77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "90ad75e0-f191-418b-a970-41fcfd500a77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:18 user nova-compute[73091]: INFO nova.compute.manager [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Terminating instance
Aug 16 08:11:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-c3e76af0-3bfe-4e01-bca6-2b25cf58ac01 req-a839543b-d455-4cd8-822e-c1f0bede3237 service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Received event network-vif-unplugged-1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c3e76af0-3bfe-4e01-bca6-2b25cf58ac01 req-a839543b-d455-4cd8-822e-c1f0bede3237 service nova] Acquiring lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c3e76af0-3bfe-4e01-bca6-2b25cf58ac01 req-a839543b-d455-4cd8-822e-c1f0bede3237 service nova] Lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c3e76af0-3bfe-4e01-bca6-2b25cf58ac01 req-a839543b-d455-4cd8-822e-c1f0bede3237 service nova] Lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-c3e76af0-3bfe-4e01-bca6-2b25cf58ac01 req-a839543b-d455-4cd8-822e-c1f0bede3237 service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] No waiting events found dispatching network-vif-unplugged-1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG nova.compute.manager [req-c3e76af0-3bfe-4e01-bca6-2b25cf58ac01 req-a839543b-d455-4cd8-822e-c1f0bede3237 service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Received event network-vif-unplugged-1c7727db-9b7f-44b2-a649-2042dc3553bb for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:11:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Instance destroyed successfully.
Aug 16 08:11:19 user nova-compute[73091]: DEBUG nova.objects.instance [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lazy-loading 'resources' on Instance uuid 90ad75e0-f191-418b-a970-41fcfd500a77 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1415630459',display_name='tempest-AttachSCSIVolumeTestJSON-server-1415630459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1415630459',id=6,image_ref='eb652581-f331-4ee9-a571-6a0d5aceb168',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBUD3pL1EUkC43Oem35lMHweYIKTnX+107tRiom3ARXT3ebFNBUUKb0PqEIklB4sBO1VnN/i7s1sxpE/xtPBZ4nWCFW9vWnLzmmvSfA4f92AXAIq3HBkAs9zSQ9sJbirQ==',key_name='tempest-keypair-1179177704',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:09:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55e6435f3eed48fa8fe390b82f4cd3e4',ramdisk_id='',reservation_id='r-57prlnlq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='eb652581-f331-4ee9-a571-6a0d5aceb168',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1899907715',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1899907715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:09:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58c70a06db7b477d8af7dc5cd752443b',uuid=90ad75e0-f191-418b-a970-41fcfd500a77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "address": "fa:16:3e:e1:6f:45", "network": {"id": "5e7781de-6e9b-4788-a042-8db14b7cf340", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1721244661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55e6435f3eed48fa8fe390b82f4cd3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7727db-9b", "ovs_interfaceid": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Converting VIF {"id": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "address": "fa:16:3e:e1:6f:45", "network": {"id": "5e7781de-6e9b-4788-a042-8db14b7cf340", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1721244661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55e6435f3eed48fa8fe390b82f4cd3e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7727db-9b", "ovs_interfaceid": "1c7727db-9b7f-44b2-a649-2042dc3553bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:6f:45,bridge_name='br-int',has_traffic_filtering=True,id=1c7727db-9b7f-44b2-a649-2042dc3553bb,network=Network(5e7781de-6e9b-4788-a042-8db14b7cf340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c7727db-9b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG os_vif [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:6f:45,bridge_name='br-int',has_traffic_filtering=True,id=1c7727db-9b7f-44b2-a649-2042dc3553bb,network=Network(5e7781de-6e9b-4788-a042-8db14b7cf340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c7727db-9b') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c7727db-9b, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:19 user nova-compute[73091]: INFO os_vif [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:6f:45,bridge_name='br-int',has_traffic_filtering=True,id=1c7727db-9b7f-44b2-a649-2042dc3553bb,network=Network(5e7781de-6e9b-4788-a042-8db14b7cf340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c7727db-9b')
Aug 16 08:11:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Deleting instance files /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77_del
Aug 16 08:11:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Deletion of /opt/stack/data/nova/instances/90ad75e0-f191-418b-a970-41fcfd500a77_del complete
Aug 16 08:11:19 user nova-compute[73091]: INFO nova.compute.manager [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 16 08:11:19 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 08:11:19 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 08:11:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:11:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:11:21 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Took 1.34 seconds to deallocate network for instance.
Aug 16 08:11:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-c8a85100-1ef1-4b77-904b-f47fd8dff00b req-a9090c29-50d1-4ddd-a90f-e876611bef60 service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Received event network-vif-deleted-1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:11:21 user nova-compute[73091]: INFO nova.compute.manager [req-c8a85100-1ef1-4b77-904b-f47fd8dff00b req-a9090c29-50d1-4ddd-a90f-e876611bef60 service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Neutron deleted interface 1c7727db-9b7f-44b2-a649-2042dc3553bb; detaching it from the instance and deleting it from the info cache
Aug 16 08:11:21 user nova-compute[73091]: DEBUG nova.network.neutron [req-c8a85100-1ef1-4b77-904b-f47fd8dff00b req-a9090c29-50d1-4ddd-a90f-e876611bef60 service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-c8a85100-1ef1-4b77-904b-f47fd8dff00b req-a9090c29-50d1-4ddd-a90f-e876611bef60 service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Detach interface failed, port_id=1c7727db-9b7f-44b2-a649-2042dc3553bb, reason: Instance 90ad75e0-f191-418b-a970-41fcfd500a77 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-d67568a0-b6d2-40cf-8f0e-fb8f64f48f15 req-4e01d325-eb4c-4ba0-8efd-cbca7aed4dfe service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Received event network-vif-plugged-1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d67568a0-b6d2-40cf-8f0e-fb8f64f48f15 req-4e01d325-eb4c-4ba0-8efd-cbca7aed4dfe service nova] Acquiring lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d67568a0-b6d2-40cf-8f0e-fb8f64f48f15 req-4e01d325-eb4c-4ba0-8efd-cbca7aed4dfe service nova] Lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d67568a0-b6d2-40cf-8f0e-fb8f64f48f15 req-4e01d325-eb4c-4ba0-8efd-cbca7aed4dfe service nova] Lock "90ad75e0-f191-418b-a970-41fcfd500a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-d67568a0-b6d2-40cf-8f0e-fb8f64f48f15 req-4e01d325-eb4c-4ba0-8efd-cbca7aed4dfe service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] No waiting events found dispatching network-vif-plugged-1c7727db-9b7f-44b2-a649-2042dc3553bb {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:11:21 user nova-compute[73091]: WARNING nova.compute.manager [req-d67568a0-b6d2-40cf-8f0e-fb8f64f48f15 req-4e01d325-eb4c-4ba0-8efd-cbca7aed4dfe service nova] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Received unexpected event network-vif-plugged-1c7727db-9b7f-44b2-a649-2042dc3553bb for instance with vm_state deleted and task_state None.
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:21 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Deleted allocations for instance 90ad75e0-f191-418b-a970-41fcfd500a77
Aug 16 08:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78a17f62-ad7e-4f80-a170-42df31ca7917 tempest-AttachSCSIVolumeTestJSON-1899907715 tempest-AttachSCSIVolumeTestJSON-1899907715-project-member] Lock "90ad75e0-f191-418b-a970-41fcfd500a77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.417s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Error from libvirt while getting description of instance-00000006: [Error Code 42] Domain not found: no domain with matching uuid '90ad75e0-f191-418b-a970-41fcfd500a77' (instance-00000006): libvirt.libvirtError: Domain not found: no domain with matching uuid '90ad75e0-f191-418b-a970-41fcfd500a77' (instance-00000006)
Aug 16 08:11:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:11:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:11:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:11:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=7028MB free_disk=25.526901245117188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance bd541280-cecf-4c1c-bd1f-f7edff830f1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4a6248b9-f577-4efd-baa2-eb5eb3e47495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance cc7973d9-c703-4345-bf58-ccbe80fd07ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance daf2b789-eba2-419b-99f6-be8f483151ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 476de8ea-30dd-4b52-be37-f134e445757f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance b4e06e3b-5389-4054-aa47-d9cf7b638c0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 6060dcaf-e451-4308-b96f-43bcbf56d621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance a7ae44fc-14fd-457c-8ae7-d8c65df6be2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 58fb6a40-f818-4515-be92-9f5dd96e40d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance bac3dbae-0134-450c-9220-0dd96e74aef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 5b610a48-4130-48db-91af-0f3926ac775b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:24 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173469.9897768, 58fb6a40-f818-4515-be92-9f5dd96e40d6 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:11:24 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] VM Stopped (Lifecycle Event)
Aug 16 08:11:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6c07de9d-f790-4fab-af8a-8b675b515228 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:11:25 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:11:25 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:11:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:11:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "refresh_cache-cc7973d9-c703-4345-bf58-ccbe80fd07ac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquired lock "refresh_cache-cc7973d9-c703-4345-bf58-ccbe80fd07ac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Updating instance_info_cache with network_info: [{"id": "75463757-0a11-47fa-8270-d756556eb589", "address": "fa:16:3e:c3:27:58", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75463757-0a", "ovs_interfaceid": "75463757-0a11-47fa-8270-d756556eb589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Releasing lock "refresh_cache-cc7973d9-c703-4345-bf58-ccbe80fd07ac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jouUMLbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a7ae44fc-14fd-457c-8ae7-d8c65df6be2d', 'attached_at': '', 'detached_at': '', 'volume_id': 'be32be16-adad-4bed-bb5c-8ce1ecdbec58', 'serial': 'be32be16-adad-4bed-bb5c-8ce1ecdbec58'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJioywhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a7ae44fc-14fd-457c-8ae7-d8c65df6be2d', 'attached_at': '', 'detached_at': '', 'volume_id': 'dbe64faf-342b-4840-9f5a-09057ec713ba', 'serial'} {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jouUMLbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:26 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:26 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:26 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a930ca19-c1b9-48ff-9e8f-bc5af6654118]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:11:26 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[701b9c40-f785-4e32-8744-52be67231d96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58] added
Aug 16 08:11:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ce028a-5062-4181-a7ff-5d7533161afe]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b2a73a-6c43-4d11-bf2e-b74d3d1c52e9]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jouUMLbc {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jouUMLbc" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cb045d-20cb-4bae-8242-5debb643e521]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jouUMLbc'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb00937-2277-411b-90d7-d53171ed25ca]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5182642e-8ac4-41be-848d-5ebf69115684]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:26 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:26 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:26 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:26 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:26 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:26 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:26 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:26 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:26 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:26 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:26 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:26 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:26 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:26 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0238242-bb4e-40ab-a6ed-29c01f87e631]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58, portal: 172.16.0.220,3260]
Aug 16 08:11:27 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58, portal: 172.16.0.220,3260] successful.
Aug 16 08:11:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[299511b6-6353-4c06-be30-4b25a7070eb4]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5cc1c1-4f66-4b10-8eb1-fac11525f7f4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:27 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:27 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4f0ab9-9262-462b-b56d-a52469bf045b]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:11:27 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jouUMLbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:11:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26162623739656563', 'path': '/dev/sdj'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162623739656563', 'path': '/dev/sdj'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:11:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lazy-loading 'flavor' on Instance uuid a7ae44fc-14fd-457c-8ae7-d8c65df6be2d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 135266304 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 246415360 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 332398592 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 447741952 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 597688320 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 793772032 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:11:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 904921088 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:11:32 user nova-compute[73091]: INFO nova.compute.claims [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Claim successful on node user
Aug 16 08:11:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 1021313024 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:32 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:11:32 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:11:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:11:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:11:32 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:11:32 user nova-compute[73091]: DEBUG nova.policy [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '196d845c007043b3aead43d76d94df07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85ea39234954b05a5a5b21cc52b30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:11:32 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:11:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:11:33 user nova-compute[73091]: INFO nova.virt.block_device [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Booting with blank volume at /dev/vda
Aug 16 08:11:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 1055916032 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:33 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Successfully created port: df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:11:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:11:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJioywhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:33 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:33 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:11:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9246b393-6014-4f30-a964-3afcc2b47801]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab094c6-f10b-4858-8544-3c12ad648d24]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:34 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8cc6f7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[65911762-72cf-4d4d-ab4a-1c07809f1965]: (4, ('path checker states:\nup                  7\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74c07f6-0b60-4a4c-a025-a06f3c15ef2f]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dbdca4-855e-4eb2-9630-2a6e1f07dd0c]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8186e966-6321-4aa1-856d-17bae83ba8f1]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[705a6bd4-ff73-4bf0-823c-3811641182bd]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[201d40a5-899d-4cde-ae0e-bb4db3d84348]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260]
Aug 16 08:11:34 user nova-compute[73091]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260] successful.
Aug 16 08:11:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.063s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[db16408e-f2e0-4814-b114-085c71c08a71]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] <== disconnect_volume: return (374ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jouUMLbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'a7ae44fc-14fd-457c-8ae7-d8c65df6be2d', 'attached_at': '', 'detached_at': '', 'volume_id': 'be32be16-adad-4bed-bb5c-8ce1ecdbec58', 'serial'} {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] swap_volume: removing Cinder connection for volume dbe64faf-342b-4840-9f5a-09057ec713ba {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Successfully updated port: df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173479.783336, 90ad75e0-f191-418b-a970-41fcfd500a77 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:11:34 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] VM Stopped (Lifecycle Event)
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquired lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1cdc85c5-5c6c-4d16-9cb3-ff3ef3ce1bc4 None None] [instance: 90ad75e0-f191-418b-a970-41fcfd500a77] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-c4d1496a-e6ed-4f58-b134-3a4adbc78af2 req-1e5b344b-4aa3-4989-82a1-f308bdfd545e service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received event network-changed-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-c4d1496a-e6ed-4f58-b134-3a4adbc78af2 req-1e5b344b-4aa3-4989-82a1-f308bdfd545e service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Refreshing instance network info cache due to event network-changed-df5af82e-6121-4551-aea4-adf6897bc4e1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4d1496a-e6ed-4f58-b134-3a4adbc78af2 req-1e5b344b-4aa3-4989-82a1-f308bdfd545e service nova] Acquiring lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:11:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:11:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] swap_volume: Updating volume dbe64faf-342b-4840-9f5a-09057ec713ba BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "jouUMLbc", "auth_password": "o1hN60G2lUuzEr", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "be32be16-adad-4bed-bb5c-8ce1ecdbec58"}, "status": "reserved", "instance": "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d", "attached_at": "", "detached_at": "", "volume_id": "be32be16-adad-4bed-bb5c-8ce1ecdbec58", "serial": "be32be16-adad-4bed-bb5c-8ce1ecdbec58"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'be32be16-adad-4bed-bb5c-8ce1ecdbec58', 'no_device': None, 'attachment_id': 'b65a86b0-1f43-404c-adb8-379c31e058b7'} {{(pid=73091) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 08:11:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-101b5964-a31c-4492-acd7-3fe15dc28fb2 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.682s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Updating instance_info_cache with network_info: [{"id": "df5af82e-6121-4551-aea4-adf6897bc4e1", "address": "fa:16:3e:49:79:1a", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5af82e-61", "ovs_interfaceid": "df5af82e-6121-4551-aea4-adf6897bc4e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:11:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Releasing lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:11:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Instance network_info: |[{"id": "df5af82e-6121-4551-aea4-adf6897bc4e1", "address": "fa:16:3e:49:79:1a", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5af82e-61", "ovs_interfaceid": "df5af82e-6121-4551-aea4-adf6897bc4e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:11:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4d1496a-e6ed-4f58-b134-3a4adbc78af2 req-1e5b344b-4aa3-4989-82a1-f308bdfd545e service nova] Acquired lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:11:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-c4d1496a-e6ed-4f58-b134-3a4adbc78af2 req-1e5b344b-4aa3-4989-82a1-f308bdfd545e service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Refreshing network info cache for port df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:11:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-c4d1496a-e6ed-4f58-b134-3a4adbc78af2 req-1e5b344b-4aa3-4989-82a1-f308bdfd545e service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Updated VIF entry in instance network info cache for port df5af82e-6121-4551-aea4-adf6897bc4e1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:11:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-c4d1496a-e6ed-4f58-b134-3a4adbc78af2 req-1e5b344b-4aa3-4989-82a1-f308bdfd545e service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Updating instance_info_cache with network_info: [{"id": "df5af82e-6121-4551-aea4-adf6897bc4e1", "address": "fa:16:3e:49:79:1a", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5af82e-61", "ovs_interfaceid": "df5af82e-6121-4551-aea4-adf6897bc4e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:11:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c4d1496a-e6ed-4f58-b134-3a4adbc78af2 req-1e5b344b-4aa3-4989-82a1-f308bdfd545e service nova] Releasing lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Acquiring lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG os_brick.utils [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[404d51bb-80cb-40c2-9109-db72a4708c48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc89571-ec52-46ac-90b5-e0120b22659e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4728f152-7b2b-42c4-8042-ead5ece7d701]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e669fa11-2eff-4e2c-b4d2-f7e49b8a9e59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:11:37 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:11:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bfc0c6-6575-47aa-9958-81825bf3611f]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:11:37 user nova-compute[73091]: DEBUG os_brick.utils [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:37 user nova-compute[73091]: INFO nova.compute.manager [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Swapping volume be32be16-adad-4bed-bb5c-8ce1ecdbec58 for dbe64faf-342b-4840-9f5a-09057ec713ba
Aug 16 08:11:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-000dafec-5ff8-4340-8f4f-fa99bcfe894c req-c668f4cc-df82-40f0-9ee8-02d90c864f18 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received event volume-reimaged-2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-000dafec-5ff8-4340-8f4f-fa99bcfe894c req-c668f4cc-df82-40f0-9ee8-02d90c864f18 service nova] Acquiring lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-000dafec-5ff8-4340-8f4f-fa99bcfe894c req-c668f4cc-df82-40f0-9ee8-02d90c864f18 service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-000dafec-5ff8-4340-8f4f-fa99bcfe894c req-c668f4cc-df82-40f0-9ee8-02d90c864f18 service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-000dafec-5ff8-4340-8f4f-fa99bcfe894c req-c668f4cc-df82-40f0-9ee8-02d90c864f18 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Processing event volume-reimaged-2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Instance event wait completed in 23 seconds for volume-reimaged {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:11:38 user nova-compute[73091]: INFO nova.virt.block_device [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Booting with volume 2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 at /dev/vda
Aug 16 08:11:38 user nova-compute[73091]: DEBUG os_brick.utils [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[345be321-81bc-42d0-b47e-04370824bae2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d36642-8518-4697-a510-cc1a90a70081]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca47876-a913-40ce-8140-2d5e93f76f92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb93f1b2-d8b2-4074-838e-08a7bd7b276d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:11:38 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4847f9e-daec-484d-9788-4f2f2d1321d8]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG os_brick.utils [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Updating existing volume attachment record: 84e9bc26-d69e-4920-a3ff-4dfe9a4512de {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG os_brick.utils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc64df8-23aa-40a9-b83e-7d50ab4d72f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf96acca-c879-4b57-b73f-d8235651d1c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[976574f6-d429-47d5-ae58-085a65bf493a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0639fe-e886-48cf-9c7c-54b032b226ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:11:38 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:11:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88231f8-0505-4d3b-a7fa-b0569591a458]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG os_brick.utils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:38 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Updating existing volume attachment record: f5ee062b-8f05-4e09-9b3a-46dbd9751bcb {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:11:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJioywhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a7ae44fc-14fd-457c-8ae7-d8c65df6be2d', 'attached_at': '', 'detached_at': '', 'volume_id': 'dbe64faf-342b-4840-9f5a-09057ec713ba', 'serial': 'dbe64faf-342b-4840-9f5a-09057ec713ba'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jouUMLbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'be32be16-adad-4bed-bb5c-8ce1ecdbec58'}, 'status': 'reserved', 'instance': 'a7ae44fc-14fd-457c-8ae7-d8c65df6be2d', 'attached_at': '', 'detached_at': '', 'volume_id': 'be32be16-adad-4bed-bb5c-8ce1ecdbec58', 'serial'} {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJioywhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:47 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:47 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:47 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3811e3cc-1eaf-4861-9d08-44e3b4f9bc65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:11:47 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eef018b-89cd-4a1a-b203-8df7df4d2762]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba] added
Aug 16 08:11:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a21f606-b2fb-48af-a742-9feb47f852b7]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40b52dd-501e-4933-a1e7-0f7f7ff8afff]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJioywhZ {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJioywhZ" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef23fd4-0931-4361-ab09-442ce1e00d5f]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QJioywhZ'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae10d42-e142-4206-9708-bfc059608480]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bd8d69-d96a-4650-9a45-caa859188f86]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[884b5dc1-1d5a-4672-b06a-4cd9f5602f76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260]
Aug 16 08:11:47 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260] successful.
Aug 16 08:11:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e4bef5-750b-4b5b-bc56-3e47107e3083]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5c0c8f-1d0b-4067-8483-31adcd512ca0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:47 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c2d1d8-3258-4c5c-a312-ef3271a536c5]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:11:48 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:11:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJioywhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:11:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26262386563346435', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262386563346435', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:11:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lazy-loading 'flavor' on Instance uuid a7ae44fc-14fd-457c-8ae7-d8c65df6be2d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 163577856 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:11:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 257949696 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 408944640 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 549453824 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 703594496 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 866123776 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 995098624 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:11:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Creating image(s)
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Ensure instance console log exists: /opt/stack/data/nova/instances/58fb6a40-f818-4515-be92-9f5dd96e40d6/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Start _get_guest_xml network_info=[{"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '84e9bc26-d69e-4920-a3ff-4dfe9a4512de', 'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWKlGuEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58fb6a40-f818-4515-be92-9f5dd96e40d6', 'attached_at': '', 'detached_at': '', 'volume_id': '2c00710f-993d-47dc-b3a1-5f6b2e1ccd59', 'serial': '2c00710f-993d-47dc-b3a1-5f6b2e1ccd59'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:11:52 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 08:11:52 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:11:52 user nova-compute[73091]: DEBUG nova.objects.instance [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lazy-loading 'vcpu_model' on Instance uuid 58fb6a40-f818-4515-be92-9f5dd96e40d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWKlGuEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:53 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:53 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:53 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66a22f4-86de-4426-abc3-a8100e956b01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:11:53 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f8221b-a45a-410a-8001-5e91aff2389d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59] added
Aug 16 08:11:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bb5454-5860-4d68-91f0-ce98d801b3e8]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ab85a1-93a6-4490-90bb-608378c9cc4f]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWKlGuEj {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWKlGuEj" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4475be-c884-4aad-9804-d3f3c7844c0b]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rWKlGuEj'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ca668b-cb5f-457a-b8fd-292a0dd4c399]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[adde7b32-b2e2-4eca-a491-9d9b9bd7558f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)
Aug 16 08:11:53 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:53 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:53 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:53 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:53 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:53 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:53 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)
Aug 16 08:11:53 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:53 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:53 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:53 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:53 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:53 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:53 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jouUMLbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'be32be16-adad-4bed-bb5c-8ce1ecdbec58'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:53 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --login" returned: 0 in 1.095s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[303d3210-b5a7-440e-b2ac-89513404e2b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260]
Aug 16 08:11:54 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260] successful.
Aug 16 08:11:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a88a07f-e949-4b62-bef9-db49461a715d]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bf12a7-bd92-4a78-9133-86515b9280b4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:54 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:54 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.349s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] HCTL ('40', '-', '-', 0) found on session 15 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7600c4-2e0f-4ffe-b906-53ea49e0210f]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Searching for a device in session 15 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWKlGuEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:11:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.385s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] <== connect_volume: return (2386ms) {'type': 'block', 'scsi_wwn': '26439383538386539', 'path': '/dev/sdi'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439383538386539', 'path': '/dev/sdi'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.114s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbec0d4-dc9a-4e4a-b54e-60c82be68bdb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T08:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-161383938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-622705224',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgwr+lPrpEP5o9ETv2V1lYpdSx5+1jSfz5g40qSuKvSXhEDtmL9vrp71E/TIr7O7WlZ5kcRETw3PrK7xu+z/FUuEGZhJeo4ndVNxGCXeTwKuExSPw6ICDcnszQlQ44bDg==',key_name='tempest-keypair-1739562332',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:09:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3cd0afcf7cd4d06b6914fd69282e6df',ramdisk_id='',reservation_id='r-j2kcg45t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1659459997',owner_user_name='tempest-ServerActionsV293TestJSON-1659459997-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb81b27063f549ab938bea843a3ed7c6',uuid=58fb6a40-f818-4515-be92-9f5dd96e40d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Converting VIF {"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:e5:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff7593ef-acd3-4f60-8f85-e4314751d437,network=Network(38194120-0573-40dd-a8f9-78e2afcb9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7593ef-ac') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:11:55 user nova-compute[73091]:   <uuid>58fb6a40-f818-4515-be92-9f5dd96e40d6</uuid>
Aug 16 08:11:55 user nova-compute[73091]:   <name>instance-0000000a</name>
Aug 16 08:11:55 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:11:55 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:11:55 user nova-compute[73091]:   <metadata>
Aug 16 08:11:55 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:11:55 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:11:55 user nova-compute[73091]:       <nova:name>tempest-ServerActionsV293TestJSON-server-161383938</nova:name>
Aug 16 08:11:55 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:11:52</nova:creationTime>
Aug 16 08:11:55 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:11:55 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:11:55 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:11:55 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:11:55 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:11:55 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:11:55 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:11:55 user nova-compute[73091]:       <nova:owner>
Aug 16 08:11:55 user nova-compute[73091]:         <nova:user uuid="eb81b27063f549ab938bea843a3ed7c6">tempest-ServerActionsV293TestJSON-1659459997-project-member</nova:user>
Aug 16 08:11:55 user nova-compute[73091]:         <nova:project uuid="e3cd0afcf7cd4d06b6914fd69282e6df">tempest-ServerActionsV293TestJSON-1659459997</nova:project>
Aug 16 08:11:55 user nova-compute[73091]:       </nova:owner>
Aug 16 08:11:55 user nova-compute[73091]:       <nova:ports>
Aug 16 08:11:55 user nova-compute[73091]:         <nova:port uuid="ff7593ef-acd3-4f60-8f85-e4314751d437">
Aug 16 08:11:55 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 08:11:55 user nova-compute[73091]:         </nova:port>
Aug 16 08:11:55 user nova-compute[73091]:       </nova:ports>
Aug 16 08:11:55 user nova-compute[73091]:     </nova:instance>
Aug 16 08:11:55 user nova-compute[73091]:   </metadata>
Aug 16 08:11:55 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:11:55 user nova-compute[73091]:     <system>
Aug 16 08:11:55 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:11:55 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:11:55 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:11:55 user nova-compute[73091]:       <entry name="serial">58fb6a40-f818-4515-be92-9f5dd96e40d6</entry>
Aug 16 08:11:55 user nova-compute[73091]:       <entry name="uuid">58fb6a40-f818-4515-be92-9f5dd96e40d6</entry>
Aug 16 08:11:55 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:11:55 user nova-compute[73091]:     </system>
Aug 16 08:11:55 user nova-compute[73091]:   </sysinfo>
Aug 16 08:11:55 user nova-compute[73091]:   <os>
Aug 16 08:11:55 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:11:55 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:11:55 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:11:55 user nova-compute[73091]:   </os>
Aug 16 08:11:55 user nova-compute[73091]:   <features>
Aug 16 08:11:55 user nova-compute[73091]:     <acpi/>
Aug 16 08:11:55 user nova-compute[73091]:     <apic/>
Aug 16 08:11:55 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:11:55 user nova-compute[73091]:   </features>
Aug 16 08:11:55 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:11:55 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:11:55 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:11:55 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:11:55 user nova-compute[73091]:   </clock>
Aug 16 08:11:55 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:11:55 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:11:55 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:11:55 user nova-compute[73091]:   </cpu>
Aug 16 08:11:55 user nova-compute[73091]:   <devices>
Aug 16 08:11:55 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:11:55 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:11:55 user nova-compute[73091]:       <source dev="/dev/sdi"/>
Aug 16 08:11:55 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:11:55 user nova-compute[73091]:       <serial>2c00710f-993d-47dc-b3a1-5f6b2e1ccd59</serial>
Aug 16 08:11:55 user nova-compute[73091]:     </disk>
Aug 16 08:11:55 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:11:55 user nova-compute[73091]:       <mac address="fa:16:3e:ba:e5:eb"/>
Aug 16 08:11:55 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:11:55 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:11:55 user nova-compute[73091]:       <target dev="tapff7593ef-ac"/>
Aug 16 08:11:55 user nova-compute[73091]:     </interface>
Aug 16 08:11:55 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:11:55 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/58fb6a40-f818-4515-be92-9f5dd96e40d6/console.log" append="off"/>
Aug 16 08:11:55 user nova-compute[73091]:     </serial>
Aug 16 08:11:55 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:11:55 user nova-compute[73091]:     <video>
Aug 16 08:11:55 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:11:55 user nova-compute[73091]:     </video>
Aug 16 08:11:55 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:11:55 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:11:55 user nova-compute[73091]:     </rng>
Aug 16 08:11:55 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:11:55 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:11:55 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:11:55 user nova-compute[73091]:     </memballoon>
Aug 16 08:11:55 user nova-compute[73091]:   </devices>
Aug 16 08:11:55 user nova-compute[73091]: </domain>
Aug 16 08:11:55 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T08:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-161383938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-622705224',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgwr+lPrpEP5o9ETv2V1lYpdSx5+1jSfz5g40qSuKvSXhEDtmL9vrp71E/TIr7O7WlZ5kcRETw3PrK7xu+z/FUuEGZhJeo4ndVNxGCXeTwKuExSPw6ICDcnszQlQ44bDg==',key_name='tempest-keypair-1739562332',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:09:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3cd0afcf7cd4d06b6914fd69282e6df',ramdisk_id='',reservation_id='r-j2kcg45t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1659459997',owner_user_name='tempest-ServerActionsV293TestJSON-1659459997-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb81b27063f549ab938bea843a3ed7c6',uuid=58fb6a40-f818-4515-be92-9f5dd96e40d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Converting VIF {"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:e5:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff7593ef-acd3-4f60-8f85-e4314751d437,network=Network(38194120-0573-40dd-a8f9-78e2afcb9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7593ef-ac') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_vif [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:e5:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff7593ef-acd3-4f60-8f85-e4314751d437,network=Network(38194120-0573-40dd-a8f9-78e2afcb9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7593ef-ac') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff7593ef-ac, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff7593ef-ac, col_values=(('external_ids', {'iface-id': 'ff7593ef-acd3-4f60-8f85-e4314751d437', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:e5:eb', 'vm-uuid': '58fb6a40-f818-4515-be92-9f5dd96e40d6'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a821714-7352-4299-bb3d-6c84b0cfc709]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:55 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9028337f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58'): ({'sdj'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Removing single pathed devices sdj {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:55 user nova-compute[73091]: INFO os_vif [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:e5:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff7593ef-acd3-4f60-8f85-e4314751d437,network=Network(38194120-0573-40dd-a8f9-78e2afcb9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7593ef-ac')
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[069ef0bc-f5d9-48b2-b479-d286b4366193]: (4, ('path checker states:\nup                  7\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[288c3e46-ac6b-4c63-999c-a3684bfcf466]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Flushing IO for device /dev/sdj {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] No VIF found with MAC fa:16:3e:ba:e5:eb, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dc9e68-2e1a-47db-8168-cc615136b5f1]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.045s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e239ee5-f85a-4a12-b45e-8d78c117426d]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] SCSI volumes sdj have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffb975a-4423-4619-9ba0-b5cf813a1663]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4baeca-1df4-4483-a311-699dfd900ba2]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58, portal: 172.16.0.220,3260]
Aug 16 08:11:55 user nova-compute[73091]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58, portal: 172.16.0.220,3260] successful.
Aug 16 08:11:55 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be32be16-adad-4bed-bb5c-8ce1ecdbec58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[50360999-06c2-4e89-82b1-4198f16fad75]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] <== disconnect_volume: return (2459ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJioywhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a7ae44fc-14fd-457c-8ae7-d8c65df6be2d', 'attached_at': '', 'detached_at': '', 'volume_id': 'dbe64faf-342b-4840-9f5a-09057ec713ba', 'serial'} {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 08:11:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] swap_volume: removing Cinder connection for volume be32be16-adad-4bed-bb5c-8ce1ecdbec58 {{(pid=73091) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 08:11:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] swap_volume: Updating volume be32be16-adad-4bed-bb5c-8ce1ecdbec58 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "QJioywhZ", "auth_password": "z6AhwlsyjKq4fT", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "dbe64faf-342b-4840-9f5a-09057ec713ba"}, "status": "reserved", "instance": "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d", "attached_at": "", "detached_at": "", "volume_id": "dbe64faf-342b-4840-9f5a-09057ec713ba", "serial": "dbe64faf-342b-4840-9f5a-09057ec713ba"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'dbe64faf-342b-4840-9f5a-09057ec713ba', 'no_device': None, 'attachment_id': '4d502918-8887-45a0-8e92-6a37910f804d'} {{(pid=73091) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 08:11:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4c21ef65-2b5f-462b-9dfc-b8e49d55fef0 tempest-TestVolumeSwap-872357718 tempest-TestVolumeSwap-872357718-project-admin] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.148s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-3c290622-2441-4b3e-bd42-3fa8a8fafd9d req-693687ba-93f3-4221-bf43-55a4059223ad service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received event network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:11:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c290622-2441-4b3e-bd42-3fa8a8fafd9d req-693687ba-93f3-4221-bf43-55a4059223ad service nova] Acquiring lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c290622-2441-4b3e-bd42-3fa8a8fafd9d req-693687ba-93f3-4221-bf43-55a4059223ad service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c290622-2441-4b3e-bd42-3fa8a8fafd9d req-693687ba-93f3-4221-bf43-55a4059223ad service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-3c290622-2441-4b3e-bd42-3fa8a8fafd9d req-693687ba-93f3-4221-bf43-55a4059223ad service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] No waiting events found dispatching network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:11:57 user nova-compute[73091]: WARNING nova.compute.manager [req-3c290622-2441-4b3e-bd42-3fa8a8fafd9d req-693687ba-93f3-4221-bf43-55a4059223ad service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received unexpected event network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 08:11:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:57 user nova-compute[73091]: INFO nova.compute.manager [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Detaching volume dbe64faf-342b-4840-9f5a-09057ec713ba
Aug 16 08:11:57 user nova-compute[73091]: INFO nova.virt.block_device [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Attempting to driver detach volume dbe64faf-342b-4840-9f5a-09057ec713ba from mountpoint /dev/vdb
Aug 16 08:11:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Attempting to detach device vdb from instance a7ae44fc-14fd-457c-8ae7-d8c65df6be2d from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 08:11:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:11:57 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:11:57 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 08:11:57 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:11:57 user nova-compute[73091]:   <serial>dbe64faf-342b-4840-9f5a-09057ec713ba</serial>
Aug 16 08:11:57 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 08:11:57 user nova-compute[73091]: </disk>
Aug 16 08:11:57 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:11:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Successfully detached device vdb from instance a7ae44fc-14fd-457c-8ae7-d8c65df6be2d from the persistent domain config.
Aug 16 08:11:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7ae44fc-14fd-457c-8ae7-d8c65df6be2d from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 08:11:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:11:57 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:11:57 user nova-compute[73091]:   <source dev="/dev/sdb"/>
Aug 16 08:11:57 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:11:57 user nova-compute[73091]:   <serial>dbe64faf-342b-4840-9f5a-09057ec713ba</serial>
Aug 16 08:11:57 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 08:11:57 user nova-compute[73091]: </disk>
Aug 16 08:11:57 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Received event <DeviceRemovedEvent: 1692173518.368047, a7ae44fc-14fd-457c-8ae7-d8c65df6be2d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7ae44fc-14fd-457c-8ae7-d8c65df6be2d {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 08:11:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Successfully detached device vdb from instance a7ae44fc-14fd-457c-8ae7-d8c65df6be2d from the live domain config.
Aug 16 08:11:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJioywhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'dbe64faf-342b-4840-9f5a-09057ec713ba'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:11:58 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72538ef-b4d2-4976-b974-a345c51f2b54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f3cfdb-ae20-4ce4-b3ab-daae33de1493]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:58 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:58 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:58 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:58 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:58 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:58 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:58 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba (non-flash)
Aug 16 08:11:58 user nova-compute[73091]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:11:58 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:11:58 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:11:58 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:11:58 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:11:58 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:11:58 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:11:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8f05bc040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba'): ({'sdb'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Removing single pathed devices sdb {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2113c79c-2f77-46b0-a4b7-32a1a09e33cc]: (4, ('path checker states:\nup                  6\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[711933c1-5f43-470a-b870-b77785379f9c]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Flushing IO for device /dev/sdb {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[787e27b2-e7eb-4f6c-89b0-d8ca86f5c5aa]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.030s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9b4598-806d-4671-9e36-75fb5abd33ee]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] SCSI volumes sdb have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[684f92b5-eda9-46e4-bd95-d4a1f40d1474]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff36c11b-d6ac-44d6-a553-07b16ad9e942]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260]
Aug 16 08:11:58 user nova-compute[73091]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba, portal: 172.16.0.220,3260] successful.
Aug 16 08:11:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe64faf-342b-4840-9f5a-09057ec713ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d347f6f6-0ee4-4b8c-b450-bc323948b87e]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] <== disconnect_volume: return (327ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:11:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173519.2774186, 58fb6a40-f818-4515-be92-9f5dd96e40d6 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:11:59 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] VM Resumed (Lifecycle Event)
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:11:59 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Instance spawned successfully.
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:11:59 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173519.2789845, 58fb6a40-f818-4515-be92-9f5dd96e40d6 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:11:59 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] VM Started (Lifecycle Event)
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:11:59 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-e4094102-63f1-4470-bd65-2a282a941b72 req-f5b3c8e2-9b7d-4a5e-b9bb-b5618084e357 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received event network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e4094102-63f1-4470-bd65-2a282a941b72 req-f5b3c8e2-9b7d-4a5e-b9bb-b5618084e357 service nova] Acquiring lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e4094102-63f1-4470-bd65-2a282a941b72 req-f5b3c8e2-9b7d-4a5e-b9bb-b5618084e357 service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e4094102-63f1-4470-bd65-2a282a941b72 req-f5b3c8e2-9b7d-4a5e-b9bb-b5618084e357 service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-e4094102-63f1-4470-bd65-2a282a941b72 req-f5b3c8e2-9b7d-4a5e-b9bb-b5618084e357 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] No waiting events found dispatching network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:11:59 user nova-compute[73091]: WARNING nova.compute.manager [req-e4094102-63f1-4470-bd65-2a282a941b72 req-f5b3c8e2-9b7d-4a5e-b9bb-b5618084e357 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received unexpected event network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.compute.manager [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73091) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lazy-loading 'flavor' on Instance uuid a7ae44fc-14fd-457c-8ae7-d8c65df6be2d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-000dafec-5ff8-4340-8f4f-fa99bcfe894c tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.088s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:11:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3e204c80-7348-4aa7-b0f0-4c0b19ddb4c6 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.776s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:12:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Creating image(s)
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Ensure instance console log exists: /opt/stack/data/nova/instances/4f76c866-84a8-499c-a96c-21a2d65ca3d4/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Start _get_guest_xml network_info=[{"id": "df5af82e-6121-4551-aea4-adf6897bc4e1", "address": "fa:16:3e:49:79:1a", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5af82e-61", "ovs_interfaceid": "df5af82e-6121-4551-aea4-adf6897bc4e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': 'f5ee062b-8f05-4e09-9b3a-46dbd9751bcb', 'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hxRqMVLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f76c866-84a8-499c-a96c-21a2d65ca3d4', 'attached_at': '', 'detached_at': '', 'volume_id': '5b085feb-a997-40d9-a120-66c7a45b64f5', 'serial': '5b085feb-a997-40d9-a120-66c7a45b64f5'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:12:01 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:12:01 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hxRqMVLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:12:01 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:12:01 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:12:01 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ad7362-173b-40c1-bb6d-fdc3daa405ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:12:01 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dafa22e-45a6-4627-873e-09ae95c3f3d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5] added
Aug 16 08:12:01 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d7a724-fbb2-419f-89c0-5fe71eb6ea03]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a8acc1-9e68-4a15-9b19-0363ebc2dc7a]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hxRqMVLy {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hxRqMVLy" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aa865f-72d1-4759-ac1c-6398c413f8ee]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hxRqMVLy'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f677fb33-bb47-45c3-8a6a-c8e3bab859f7]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59376bb-055b-4f2c-af91-b368f40341c6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:01 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:01 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0c707c-3d15-4179-b52f-ed87638d91f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5, portal: 172.16.0.220,3260]
Aug 16 08:12:01 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5, portal: 172.16.0.220,3260] successful.
Aug 16 08:12:01 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbf38d1-993f-4676-9615-07b1f97e2513]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a307e74-13b3-4715-b9e5-860fbb8c0e44]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:01 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:12:01 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:01 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7656e8-2f71-483b-a18f-bbd18ad1cb51]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:12:01 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hxRqMVLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26130376137663264', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130376137663264', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1769191166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1769191166',id=13,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c85ea39234954b05a5a5b21cc52b30ec',ramdisk_id='',reservation_id='r-03jttq7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1623646564',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:11:33Z,user_data=None,user_id='196d845c007043b3aead43d76d94df07',uuid=4f76c866-84a8-499c-a96c-21a2d65ca3d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df5af82e-6121-4551-aea4-adf6897bc4e1", "address": "fa:16:3e:49:79:1a", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5af82e-61", "ovs_interfaceid": "df5af82e-6121-4551-aea4-adf6897bc4e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Converting VIF {"id": "df5af82e-6121-4551-aea4-adf6897bc4e1", "address": "fa:16:3e:49:79:1a", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5af82e-61", "ovs_interfaceid": "df5af82e-6121-4551-aea4-adf6897bc4e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:79:1a,bridge_name='br-int',has_traffic_filtering=True,id=df5af82e-6121-4551-aea4-adf6897bc4e1,network=Network(231d0163-8e3c-408f-bc7d-92a34ba1fde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5af82e-61') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f76c866-84a8-499c-a96c-21a2d65ca3d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:12:02 user nova-compute[73091]:   <uuid>4f76c866-84a8-499c-a96c-21a2d65ca3d4</uuid>
Aug 16 08:12:02 user nova-compute[73091]:   <name>instance-0000000d</name>
Aug 16 08:12:02 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:12:02 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:12:02 user nova-compute[73091]:   <metadata>
Aug 16 08:12:02 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:12:02 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:12:02 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1769191166</nova:name>
Aug 16 08:12:02 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:12:01</nova:creationTime>
Aug 16 08:12:02 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:12:02 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:12:02 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:12:02 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:12:02 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:12:02 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:12:02 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:12:02 user nova-compute[73091]:       <nova:owner>
Aug 16 08:12:02 user nova-compute[73091]:         <nova:user uuid="196d845c007043b3aead43d76d94df07">tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member</nova:user>
Aug 16 08:12:02 user nova-compute[73091]:         <nova:project uuid="c85ea39234954b05a5a5b21cc52b30ec">tempest-ServerBootFromVolumeStableRescueTest-1623646564</nova:project>
Aug 16 08:12:02 user nova-compute[73091]:       </nova:owner>
Aug 16 08:12:02 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:12:02 user nova-compute[73091]:       <nova:ports>
Aug 16 08:12:02 user nova-compute[73091]:         <nova:port uuid="df5af82e-6121-4551-aea4-adf6897bc4e1">
Aug 16 08:12:02 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 08:12:02 user nova-compute[73091]:         </nova:port>
Aug 16 08:12:02 user nova-compute[73091]:       </nova:ports>
Aug 16 08:12:02 user nova-compute[73091]:     </nova:instance>
Aug 16 08:12:02 user nova-compute[73091]:   </metadata>
Aug 16 08:12:02 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:12:02 user nova-compute[73091]:     <system>
Aug 16 08:12:02 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:12:02 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:12:02 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:12:02 user nova-compute[73091]:       <entry name="serial">4f76c866-84a8-499c-a96c-21a2d65ca3d4</entry>
Aug 16 08:12:02 user nova-compute[73091]:       <entry name="uuid">4f76c866-84a8-499c-a96c-21a2d65ca3d4</entry>
Aug 16 08:12:02 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:12:02 user nova-compute[73091]:     </system>
Aug 16 08:12:02 user nova-compute[73091]:   </sysinfo>
Aug 16 08:12:02 user nova-compute[73091]:   <os>
Aug 16 08:12:02 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:12:02 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:12:02 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:12:02 user nova-compute[73091]:   </os>
Aug 16 08:12:02 user nova-compute[73091]:   <features>
Aug 16 08:12:02 user nova-compute[73091]:     <acpi/>
Aug 16 08:12:02 user nova-compute[73091]:     <apic/>
Aug 16 08:12:02 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:12:02 user nova-compute[73091]:   </features>
Aug 16 08:12:02 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:12:02 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:12:02 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:12:02 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:12:02 user nova-compute[73091]:   </clock>
Aug 16 08:12:02 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:12:02 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:12:02 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:12:02 user nova-compute[73091]:   </cpu>
Aug 16 08:12:02 user nova-compute[73091]:   <devices>
Aug 16 08:12:02 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:12:02 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:12:02 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 08:12:02 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:12:02 user nova-compute[73091]:       <serial>5b085feb-a997-40d9-a120-66c7a45b64f5</serial>
Aug 16 08:12:02 user nova-compute[73091]:     </disk>
Aug 16 08:12:02 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:12:02 user nova-compute[73091]:       <mac address="fa:16:3e:49:79:1a"/>
Aug 16 08:12:02 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:12:02 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:12:02 user nova-compute[73091]:       <target dev="tapdf5af82e-61"/>
Aug 16 08:12:02 user nova-compute[73091]:     </interface>
Aug 16 08:12:02 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:12:02 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/4f76c866-84a8-499c-a96c-21a2d65ca3d4/console.log" append="off"/>
Aug 16 08:12:02 user nova-compute[73091]:     </serial>
Aug 16 08:12:02 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:12:02 user nova-compute[73091]:     <video>
Aug 16 08:12:02 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:12:02 user nova-compute[73091]:     </video>
Aug 16 08:12:02 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:12:02 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:12:02 user nova-compute[73091]:     </rng>
Aug 16 08:12:02 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:12:02 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:12:02 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:12:02 user nova-compute[73091]:     </memballoon>
Aug 16 08:12:02 user nova-compute[73091]:   </devices>
Aug 16 08:12:02 user nova-compute[73091]: </domain>
Aug 16 08:12:02 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1769191166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1769191166',id=13,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c85ea39234954b05a5a5b21cc52b30ec',ramdisk_id='',reservation_id='r-03jttq7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1623646564',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:11:33Z,user_data=None,user_id='196d845c007043b3aead43d76d94df07',uuid=4f76c866-84a8-499c-a96c-21a2d65ca3d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df5af82e-6121-4551-aea4-adf6897bc4e1", "address": "fa:16:3e:49:79:1a", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5af82e-61", "ovs_interfaceid": "df5af82e-6121-4551-aea4-adf6897bc4e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Converting VIF {"id": "df5af82e-6121-4551-aea4-adf6897bc4e1", "address": "fa:16:3e:49:79:1a", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5af82e-61", "ovs_interfaceid": "df5af82e-6121-4551-aea4-adf6897bc4e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:79:1a,bridge_name='br-int',has_traffic_filtering=True,id=df5af82e-6121-4551-aea4-adf6897bc4e1,network=Network(231d0163-8e3c-408f-bc7d-92a34ba1fde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5af82e-61') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG os_vif [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:79:1a,bridge_name='br-int',has_traffic_filtering=True,id=df5af82e-6121-4551-aea4-adf6897bc4e1,network=Network(231d0163-8e3c-408f-bc7d-92a34ba1fde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5af82e-61') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf5af82e-61, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf5af82e-61, col_values=(('external_ids', {'iface-id': 'df5af82e-6121-4551-aea4-adf6897bc4e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:79:1a', 'vm-uuid': '4f76c866-84a8-499c-a96c-21a2d65ca3d4'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:02 user nova-compute[73091]: INFO os_vif [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:79:1a,bridge_name='br-int',has_traffic_filtering=True,id=df5af82e-6121-4551-aea4-adf6897bc4e1,network=Network(231d0163-8e3c-408f-bc7d-92a34ba1fde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5af82e-61')
Aug 16 08:12:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:12:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] No VIF found with MAC fa:16:3e:49:79:1a, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:12:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-e5714451-766e-4683-abe8-8783a34d4ee4 req-079765df-2da6-48a1-b70d-b0dd5997c237 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e5714451-766e-4683-abe8-8783a34d4ee4 req-079765df-2da6-48a1-b70d-b0dd5997c237 service nova] Acquiring lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e5714451-766e-4683-abe8-8783a34d4ee4 req-079765df-2da6-48a1-b70d-b0dd5997c237 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e5714451-766e-4683-abe8-8783a34d4ee4 req-079765df-2da6-48a1-b70d-b0dd5997c237 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:04 user nova-compute[73091]: DEBUG nova.compute.manager [req-e5714451-766e-4683-abe8-8783a34d4ee4 req-079765df-2da6-48a1-b70d-b0dd5997c237 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] No waiting events found dispatching network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:04 user nova-compute[73091]: WARNING nova.compute.manager [req-e5714451-766e-4683-abe8-8783a34d4ee4 req-079765df-2da6-48a1-b70d-b0dd5997c237 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received unexpected event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 for instance with vm_state building and task_state spawning.
Aug 16 08:12:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173526.54159, 4f76c866-84a8-499c-a96c-21a2d65ca3d4 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:12:06 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] VM Resumed (Lifecycle Event)
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:12:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Instance spawned successfully.
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:06 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173526.5504725, 4f76c866-84a8-499c-a96c-21a2d65ca3d4 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:12:06 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] VM Started (Lifecycle Event)
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:12:06 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:12:06 user nova-compute[73091]: INFO nova.compute.manager [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Took 5.24 seconds to spawn the instance on the hypervisor.
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-357f6c7e-4d4d-463a-a4d9-795e0d684218 req-b2659253-eead-44f8-84b6-3c7c184977e4 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-357f6c7e-4d4d-463a-a4d9-795e0d684218 req-b2659253-eead-44f8-84b6-3c7c184977e4 service nova] Acquiring lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-357f6c7e-4d4d-463a-a4d9-795e0d684218 req-b2659253-eead-44f8-84b6-3c7c184977e4 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-357f6c7e-4d4d-463a-a4d9-795e0d684218 req-b2659253-eead-44f8-84b6-3c7c184977e4 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:06 user nova-compute[73091]: DEBUG nova.compute.manager [req-357f6c7e-4d4d-463a-a4d9-795e0d684218 req-b2659253-eead-44f8-84b6-3c7c184977e4 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] No waiting events found dispatching network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:06 user nova-compute[73091]: WARNING nova.compute.manager [req-357f6c7e-4d4d-463a-a4d9-795e0d684218 req-b2659253-eead-44f8-84b6-3c7c184977e4 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received unexpected event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 for instance with vm_state building and task_state spawning.
Aug 16 08:12:06 user nova-compute[73091]: INFO nova.compute.manager [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Took 34.54 seconds to build instance.
Aug 16 08:12:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfe5cad-5d91-4953-b58f-0d6895a94a88 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.671s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Acquiring lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Acquiring lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:10 user nova-compute[73091]: INFO nova.compute.manager [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Terminating instance
Aug 16 08:12:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 08:12:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Instance destroyed successfully.
Aug 16 08:12:11 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lazy-loading 'resources' on Instance uuid b4e06e3b-5389-4054-aa47-d9cf7b638c0f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-241928249',display_name='tempest-VolumesAssistedSnapshotsTest-server-241928249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-241928249',id=7,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCJDbi5MnIfN3Wpi7R5r0WCI1NXaEwyFLWFnLORYIeXcThgPhGirGb2Cq1WYjTAt2MEFEhpfCtRdsEzkj34+OeB1XmkV/p0pc9kzTHX2IWO7rSCSbE3+S6eToS5PS85qw==',key_name='tempest-keypair-1208312729',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:09:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e22a1ba2cdb847069b9569ab9fb1aa21',ramdisk_id='',reservation_id='r-eqy5z0kz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1268010047',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1268010047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:09:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce62fe92b9c64cb9bf3eb51c125944b3',uuid=b4e06e3b-5389-4054-aa47-d9cf7b638c0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "address": "fa:16:3e:a4:45:19", "network": {"id": "c88e54d4-1e76-4448-9ff8-28b8a98e4fbf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1243695789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22a1ba2cdb847069b9569ab9fb1aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf79f747e-95", "ovs_interfaceid": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Converting VIF {"id": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "address": "fa:16:3e:a4:45:19", "network": {"id": "c88e54d4-1e76-4448-9ff8-28b8a98e4fbf", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1243695789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22a1ba2cdb847069b9569ab9fb1aa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf79f747e-95", "ovs_interfaceid": "f79f747e-9580-4ea0-95a5-d70f3564ebca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:45:19,bridge_name='br-int',has_traffic_filtering=True,id=f79f747e-9580-4ea0-95a5-d70f3564ebca,network=Network(c88e54d4-1e76-4448-9ff8-28b8a98e4fbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf79f747e-95') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG os_vif [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:45:19,bridge_name='br-int',has_traffic_filtering=True,id=f79f747e-9580-4ea0-95a5-d70f3564ebca,network=Network(c88e54d4-1e76-4448-9ff8-28b8a98e4fbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf79f747e-95') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf79f747e-95, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-8690eab9-aca4-49d6-81cb-c7d54e9551fe req-078b4063-a993-4ec8-97e2-28003611d695 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Received event network-vif-unplugged-f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8690eab9-aca4-49d6-81cb-c7d54e9551fe req-078b4063-a993-4ec8-97e2-28003611d695 service nova] Acquiring lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8690eab9-aca4-49d6-81cb-c7d54e9551fe req-078b4063-a993-4ec8-97e2-28003611d695 service nova] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8690eab9-aca4-49d6-81cb-c7d54e9551fe req-078b4063-a993-4ec8-97e2-28003611d695 service nova] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-8690eab9-aca4-49d6-81cb-c7d54e9551fe req-078b4063-a993-4ec8-97e2-28003611d695 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] No waiting events found dispatching network-vif-unplugged-f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-8690eab9-aca4-49d6-81cb-c7d54e9551fe req-078b4063-a993-4ec8-97e2-28003611d695 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Received event network-vif-unplugged-f79f747e-9580-4ea0-95a5-d70f3564ebca for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:11 user nova-compute[73091]: INFO os_vif [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:45:19,bridge_name='br-int',has_traffic_filtering=True,id=f79f747e-9580-4ea0-95a5-d70f3564ebca,network=Network(c88e54d4-1e76-4448-9ff8-28b8a98e4fbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf79f747e-95')
Aug 16 08:12:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Deleting instance files /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f_del
Aug 16 08:12:11 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Deletion of /opt/stack/data/nova/instances/b4e06e3b-5389-4054-aa47-d9cf7b638c0f_del complete
Aug 16 08:12:11 user nova-compute[73091]: INFO nova.compute.manager [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 16 08:12:11 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 08:12:11 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 08:12:13 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-23bda60e-4317-4c71-a8d7-76884b08c1bf req-ca99e04b-8505-4d50-b312-4db930be516d service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Received event network-vif-plugged-f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23bda60e-4317-4c71-a8d7-76884b08c1bf req-ca99e04b-8505-4d50-b312-4db930be516d service nova] Acquiring lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23bda60e-4317-4c71-a8d7-76884b08c1bf req-ca99e04b-8505-4d50-b312-4db930be516d service nova] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-23bda60e-4317-4c71-a8d7-76884b08c1bf req-ca99e04b-8505-4d50-b312-4db930be516d service nova] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-23bda60e-4317-4c71-a8d7-76884b08c1bf req-ca99e04b-8505-4d50-b312-4db930be516d service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] No waiting events found dispatching network-vif-plugged-f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:13 user nova-compute[73091]: WARNING nova.compute.manager [req-23bda60e-4317-4c71-a8d7-76884b08c1bf req-ca99e04b-8505-4d50-b312-4db930be516d service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Received unexpected event network-vif-plugged-f79f747e-9580-4ea0-95a5-d70f3564ebca for instance with vm_state active and task_state deleting.
Aug 16 08:12:13 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Took 2.04 seconds to deallocate network for instance.
Aug 16 08:12:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-b853c99f-ef25-4bba-a1c5-ff68692c13a6 req-abf0b446-c201-4e68-91ef-60e965156069 service nova] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Received event network-vif-deleted-f79f747e-9580-4ea0-95a5-d70f3564ebca {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:14 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:12:14 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:12:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:14 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Deleted allocations for instance b4e06e3b-5389-4054-aa47-d9cf7b638c0f
Aug 16 08:12:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6ab6b98b-9f99-439b-a692-086e4f70f893 tempest-VolumesAssistedSnapshotsTest-1268010047 tempest-VolumesAssistedSnapshotsTest-1268010047-project-member] Lock "b4e06e3b-5389-4054-aa47-d9cf7b638c0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.670s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:12:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:12:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:21 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:12:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:12:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:12:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:12:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:12:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:12:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:12:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:12:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:12:23 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=7176MB free_disk=25.60234832763672GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance bd541280-cecf-4c1c-bd1f-f7edff830f1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4a6248b9-f577-4efd-baa2-eb5eb3e47495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance cc7973d9-c703-4345-bf58-ccbe80fd07ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance daf2b789-eba2-419b-99f6-be8f483151ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 476de8ea-30dd-4b52-be37-f134e445757f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 6060dcaf-e451-4308-b96f-43bcbf56d621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance a7ae44fc-14fd-457c-8ae7-d8c65df6be2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 58fb6a40-f818-4515-be92-9f5dd96e40d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance bac3dbae-0134-450c-9220-0dd96e74aef0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 5b610a48-4130-48db-91af-0f3926ac775b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4f76c866-84a8-499c-a96c-21a2d65ca3d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:12:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:12:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:12:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:12:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquired lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:12:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "18850651-02ac-459a-838c-b3216bcbe131" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173531.3641264, b4e06e3b-5389-4054-aa47-d9cf7b638c0f => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:12:26 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] VM Stopped (Lifecycle Event)
Aug 16 08:12:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4e62efa6-4dcc-4edd-ae38-59d5c402bbe9 None None] [instance: b4e06e3b-5389-4054-aa47-d9cf7b638c0f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:12:26 user nova-compute[73091]: INFO nova.compute.claims [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Claim successful on node user
Aug 16 08:12:26 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Updating instance_info_cache with network_info: [{"id": "a8445f80-1201-4794-b715-36e357399997", "address": "fa:16:3e:d2:ee:e5", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8445f80-12", "ovs_interfaceid": "a8445f80-1201-4794-b715-36e357399997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Releasing lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:12:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:12:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG nova.policy [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5a61e00249d4bc4b14dd0ab5b88e58c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc3a302cc78494296980753b56edb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:12:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Creating image(s)
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "/opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "/opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "/opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-cd0a0305-339a-4966-8edc-d343d0884aca req-a295d311-082e-41ea-b549-2cfbe69454f6 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-changed-2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-cd0a0305-339a-4966-8edc-d343d0884aca req-a295d311-082e-41ea-b549-2cfbe69454f6 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing instance network info cache due to event network-changed-2008915e-4e3b-4433-94c5-b837a4533e72. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cd0a0305-339a-4966-8edc-d343d0884aca req-a295d311-082e-41ea-b549-2cfbe69454f6 service nova] Acquiring lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cd0a0305-339a-4966-8edc-d343d0884aca req-a295d311-082e-41ea-b549-2cfbe69454f6 service nova] Acquired lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-cd0a0305-339a-4966-8edc-d343d0884aca req-a295d311-082e-41ea-b549-2cfbe69454f6 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Refreshing network info cache for port 2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.225s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk 1073741824" returned: 0 in 0.061s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-ab171087-85c4-43dd-8168-6a17c5982d0f req-fb771a9a-816f-4ea6-beba-3e2872f4e477 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-changed-81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-ab171087-85c4-43dd-8168-6a17c5982d0f req-fb771a9a-816f-4ea6-beba-3e2872f4e477 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing instance network info cache due to event network-changed-81da5d0c-cecc-40d5-b7d4-332741f3c96f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ab171087-85c4-43dd-8168-6a17c5982d0f req-fb771a9a-816f-4ea6-beba-3e2872f4e477 service nova] Acquiring lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ab171087-85c4-43dd-8168-6a17c5982d0f req-fb771a9a-816f-4ea6-beba-3e2872f4e477 service nova] Acquired lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG nova.network.neutron [req-ab171087-85c4-43dd-8168-6a17c5982d0f req-fb771a9a-816f-4ea6-beba-3e2872f4e477 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Refreshing network info cache for port 81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Cannot resize image /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lazy-loading 'migration_context' on Instance uuid 18850651-02ac-459a-838c-b3216bcbe131 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Ensure instance console log exists: /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "476de8ea-30dd-4b52-be37-f134e445757f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lazy-loading 'flavor' on Instance uuid 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "476de8ea-30dd-4b52-be37-f134e445757f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "476de8ea-30dd-4b52-be37-f134e445757f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:29 user nova-compute[73091]: INFO nova.compute.manager [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Attaching volume 0f37e5a8-0be3-43d7-bff6-390364c5e37c to /dev/vdb
Aug 16 08:12:29 user nova-compute[73091]: DEBUG nova.network.neutron [req-cd0a0305-339a-4966-8edc-d343d0884aca req-a295d311-082e-41ea-b549-2cfbe69454f6 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updated VIF entry in instance network info cache for port 2008915e-4e3b-4433-94c5-b837a4533e72. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG nova.network.neutron [req-cd0a0305-339a-4966-8edc-d343d0884aca req-a295d311-082e-41ea-b549-2cfbe69454f6 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating instance_info_cache with network_info: [{"id": "2008915e-4e3b-4433-94c5-b837a4533e72", "address": "fa:16:3e:27:b1:72", "network": {"id": "08557a22-e386-4104-8e71-09e5287b1560", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-735103643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008915e-4e", "ovs_interfaceid": "2008915e-4e3b-4433-94c5-b837a4533e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98aea5dd-a8b3-493c-88b7-39b279a71065", "address": "fa:16:3e:2e:16:79", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aea5dd-a8", "ovs_interfaceid": "98aea5dd-a8b3-493c-88b7-39b279a71065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "address": "fa:16:3e:c1:b6:6b", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6f6e98-0c", "ovs_interfaceid": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "address": "fa:16:3e:98:9d:73", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12399afc-df", "ovs_interfaceid": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "address": "fa:16:3e:97:e5:41", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f21c70-35", "ovs_interfaceid": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3016cdef-2342-41d7-af0a-feee127affa8", "address": "fa:16:3e:3c:0a:32", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3016cdef-23", "ovs_interfaceid": "3016cdef-2342-41d7-af0a-feee127affa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "address": "fa:16:3e:35:54:2d", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13190e58-60", "ovs_interfaceid": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cd0a0305-339a-4966-8edc-d343d0884aca req-a295d311-082e-41ea-b549-2cfbe69454f6 service nova] Releasing lock "refresh_cache-5b610a48-4130-48db-91af-0f3926ac775b" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Successfully created port: 439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG os_brick.utils [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8627dc-0a7c-4a5d-acca-99cd77566c3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG nova.network.neutron [req-ab171087-85c4-43dd-8168-6a17c5982d0f req-fb771a9a-816f-4ea6-beba-3e2872f4e477 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updated VIF entry in instance network info cache for port 81da5d0c-cecc-40d5-b7d4-332741f3c96f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG nova.network.neutron [req-ab171087-85c4-43dd-8168-6a17c5982d0f req-fb771a9a-816f-4ea6-beba-3e2872f4e477 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating instance_info_cache with network_info: [{"id": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "address": "fa:16:3e:26:bd:cb", "network": {"id": "1759d93e-5701-4061-b3b6-e192d31f3d94", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-648102261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81da5d0c-ce", "ovs_interfaceid": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "address": "fa:16:3e:0c:14:b8", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404c0ed4-2b", "ovs_interfaceid": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "address": "fa:16:3e:09:f9:0a", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c3edd9-64", "ovs_interfaceid": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2725555-04ce-4049-ad18-6c7164352ea0", "address": "fa:16:3e:7f:c1:00", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2725555-04", "ovs_interfaceid": "b2725555-04ce-4049-ad18-6c7164352ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9baf88a2-e23e-40b7-bf28-112e53995573]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ab171087-85c4-43dd-8168-6a17c5982d0f req-fb771a9a-816f-4ea6-beba-3e2872f4e477 service nova] Releasing lock "refresh_cache-bac3dbae-0134-450c-9220-0dd96e74aef0" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:12:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e91244-808f-47b0-a225-8c6211be6d8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e331e8-b0ce-4ea1-9912-a4a98abe5b2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:12:30 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:12:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[de860582-9072-496b-b2e5-7e8a86f3589c]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG os_brick.utils [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating existing volume attachment record: 15cd2319-52f0-4875-a38e-f2ac67b60786 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Successfully updated port: 439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "refresh_cache-18850651-02ac-459a-838c-b3216bcbe131" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquired lock "refresh_cache-18850651-02ac-459a-838c-b3216bcbe131" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-08c93d45-b959-46b5-946a-4bff7d4b53eb req-c7aa939d-97b0-4ed6-822c-8b2219334995 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received event network-changed-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-08c93d45-b959-46b5-946a-4bff7d4b53eb req-c7aa939d-97b0-4ed6-822c-8b2219334995 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Refreshing instance network info cache due to event network-changed-439b29b8-64e3-40fe-b28b-0f8e05155ab6. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:12:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08c93d45-b959-46b5-946a-4bff7d4b53eb req-c7aa939d-97b0-4ed6-822c-8b2219334995 service nova] Acquiring lock "refresh_cache-18850651-02ac-459a-838c-b3216bcbe131" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:31 user nova-compute[73091]: INFO nova.compute.manager [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Terminating instance
Aug 16 08:12:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "5b610a48-4130-48db-91af-0f3926ac775b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:31 user nova-compute[73091]: INFO nova.compute.manager [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Terminating instance
Aug 16 08:12:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-21f11c51-3eb6-4215-9662-ce658ae38e6a req-5ec1e3ae-2f2d-42e5-a6bc-2072dbd8fa07 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-45f2c112-2fab-4db9-8476-8639488f678a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-21f11c51-3eb6-4215-9662-ce658ae38e6a req-5ec1e3ae-2f2d-42e5-a6bc-2072dbd8fa07 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-21f11c51-3eb6-4215-9662-ce658ae38e6a req-5ec1e3ae-2f2d-42e5-a6bc-2072dbd8fa07 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-21f11c51-3eb6-4215-9662-ce658ae38e6a req-5ec1e3ae-2f2d-42e5-a6bc-2072dbd8fa07 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-21f11c51-3eb6-4215-9662-ce658ae38e6a req-5ec1e3ae-2f2d-42e5-a6bc-2072dbd8fa07 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-unplugged-45f2c112-2fab-4db9-8476-8639488f678a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG nova.compute.manager [req-21f11c51-3eb6-4215-9662-ce658ae38e6a req-5ec1e3ae-2f2d-42e5-a6bc-2072dbd8fa07 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-45f2c112-2fab-4db9-8476-8639488f678a for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.network.neutron [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Updating instance_info_cache with network_info: [{"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Releasing lock "refresh_cache-18850651-02ac-459a-838c-b3216bcbe131" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Instance network_info: |[{"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08c93d45-b959-46b5-946a-4bff7d4b53eb req-c7aa939d-97b0-4ed6-822c-8b2219334995 service nova] Acquired lock "refresh_cache-18850651-02ac-459a-838c-b3216bcbe131" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.network.neutron [req-08c93d45-b959-46b5-946a-4bff7d4b53eb req-c7aa939d-97b0-4ed6-822c-8b2219334995 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Refreshing network info cache for port 439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Start _get_guest_xml network_info=[{"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:12:32 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1764805922',display_name='tempest-tempest.common.compute-instance-1764805922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1764805922',id=14,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz3j860Gkv1Slc5oyCWy6VoP7hKNPEjEuai3DW0jmBORKbAqdoKcQLb4MoAKfM8zJIG4wm2vu7GJkTGhorCXdn6cmATTCXJNllAcczoCXr4+3AVbBT7pCqZb5Uvu2XtIw==',key_name='tempest-keypair-502085907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fc3a302cc78494296980753b56edb0c',ramdisk_id='',reservation_id='r-wmdyi2tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-534432070',owner_user_name='tempest-ServerActionsTestOtherA-534432070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:12:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5a61e00249d4bc4b14dd0ab5b88e58c',uuid=18850651-02ac-459a-838c-b3216bcbe131,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converting VIF {"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:72:46,bridge_name='br-int',has_traffic_filtering=True,id=439b29b8-64e3-40fe-b28b-0f8e05155ab6,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap439b29b8-64') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lazy-loading 'pci_devices' on Instance uuid 18850651-02ac-459a-838c-b3216bcbe131 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:12:32 user nova-compute[73091]:   <uuid>18850651-02ac-459a-838c-b3216bcbe131</uuid>
Aug 16 08:12:32 user nova-compute[73091]:   <name>instance-0000000e</name>
Aug 16 08:12:32 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:12:32 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:12:32 user nova-compute[73091]:   <metadata>
Aug 16 08:12:32 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:12:32 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:12:32 user nova-compute[73091]:       <nova:name>tempest-tempest.common.compute-instance-1764805922</nova:name>
Aug 16 08:12:32 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:12:32</nova:creationTime>
Aug 16 08:12:32 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:12:32 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:12:32 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:12:32 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:12:32 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:12:32 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:12:32 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:12:32 user nova-compute[73091]:       <nova:owner>
Aug 16 08:12:32 user nova-compute[73091]:         <nova:user uuid="c5a61e00249d4bc4b14dd0ab5b88e58c">tempest-ServerActionsTestOtherA-534432070-project-member</nova:user>
Aug 16 08:12:32 user nova-compute[73091]:         <nova:project uuid="2fc3a302cc78494296980753b56edb0c">tempest-ServerActionsTestOtherA-534432070</nova:project>
Aug 16 08:12:32 user nova-compute[73091]:       </nova:owner>
Aug 16 08:12:32 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:12:32 user nova-compute[73091]:       <nova:ports>
Aug 16 08:12:32 user nova-compute[73091]:         <nova:port uuid="439b29b8-64e3-40fe-b28b-0f8e05155ab6">
Aug 16 08:12:32 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 08:12:32 user nova-compute[73091]:         </nova:port>
Aug 16 08:12:32 user nova-compute[73091]:       </nova:ports>
Aug 16 08:12:32 user nova-compute[73091]:     </nova:instance>
Aug 16 08:12:32 user nova-compute[73091]:   </metadata>
Aug 16 08:12:32 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:12:32 user nova-compute[73091]:     <system>
Aug 16 08:12:32 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:12:32 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:12:32 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:12:32 user nova-compute[73091]:       <entry name="serial">18850651-02ac-459a-838c-b3216bcbe131</entry>
Aug 16 08:12:32 user nova-compute[73091]:       <entry name="uuid">18850651-02ac-459a-838c-b3216bcbe131</entry>
Aug 16 08:12:32 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:12:32 user nova-compute[73091]:     </system>
Aug 16 08:12:32 user nova-compute[73091]:   </sysinfo>
Aug 16 08:12:32 user nova-compute[73091]:   <os>
Aug 16 08:12:32 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:12:32 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:12:32 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:12:32 user nova-compute[73091]:   </os>
Aug 16 08:12:32 user nova-compute[73091]:   <features>
Aug 16 08:12:32 user nova-compute[73091]:     <acpi/>
Aug 16 08:12:32 user nova-compute[73091]:     <apic/>
Aug 16 08:12:32 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:12:32 user nova-compute[73091]:   </features>
Aug 16 08:12:32 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:12:32 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:12:32 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:12:32 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:12:32 user nova-compute[73091]:   </clock>
Aug 16 08:12:32 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:12:32 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:12:32 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:12:32 user nova-compute[73091]:   </cpu>
Aug 16 08:12:32 user nova-compute[73091]:   <devices>
Aug 16 08:12:32 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:12:32 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:12:32 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk"/>
Aug 16 08:12:32 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:12:32 user nova-compute[73091]:     </disk>
Aug 16 08:12:32 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:12:32 user nova-compute[73091]:       <mac address="fa:16:3e:99:72:46"/>
Aug 16 08:12:32 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:12:32 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:12:32 user nova-compute[73091]:       <target dev="tap439b29b8-64"/>
Aug 16 08:12:32 user nova-compute[73091]:     </interface>
Aug 16 08:12:32 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:12:32 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/console.log" append="off"/>
Aug 16 08:12:32 user nova-compute[73091]:     </serial>
Aug 16 08:12:32 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:12:32 user nova-compute[73091]:     <video>
Aug 16 08:12:32 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:12:32 user nova-compute[73091]:     </video>
Aug 16 08:12:32 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:12:32 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:12:32 user nova-compute[73091]:     </rng>
Aug 16 08:12:32 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:12:32 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:12:32 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:12:32 user nova-compute[73091]:     </memballoon>
Aug 16 08:12:32 user nova-compute[73091]:   </devices>
Aug 16 08:12:32 user nova-compute[73091]: </domain>
Aug 16 08:12:32 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1764805922',display_name='tempest-tempest.common.compute-instance-1764805922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1764805922',id=14,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz3j860Gkv1Slc5oyCWy6VoP7hKNPEjEuai3DW0jmBORKbAqdoKcQLb4MoAKfM8zJIG4wm2vu7GJkTGhorCXdn6cmATTCXJNllAcczoCXr4+3AVbBT7pCqZb5Uvu2XtIw==',key_name='tempest-keypair-502085907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fc3a302cc78494296980753b56edb0c',ramdisk_id='',reservation_id='r-wmdyi2tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-534432070',owner_user_name='tempest-ServerActionsTestOtherA-534432070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:12:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5a61e00249d4bc4b14dd0ab5b88e58c',uuid=18850651-02ac-459a-838c-b3216bcbe131,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converting VIF {"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:72:46,bridge_name='br-int',has_traffic_filtering=True,id=439b29b8-64e3-40fe-b28b-0f8e05155ab6,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap439b29b8-64') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG os_vif [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:72:46,bridge_name='br-int',has_traffic_filtering=True,id=439b29b8-64e3-40fe-b28b-0f8e05155ab6,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap439b29b8-64') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap439b29b8-64, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap439b29b8-64, col_values=(('external_ids', {'iface-id': '439b29b8-64e3-40fe-b28b-0f8e05155ab6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:72:46', 'vm-uuid': '18850651-02ac-459a-838c-b3216bcbe131'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: INFO os_vif [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:72:46,bridge_name='br-int',has_traffic_filtering=True,id=439b29b8-64e3-40fe-b28b-0f8e05155ab6,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap439b29b8-64')
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] No VIF found with MAC fa:16:3e:99:72:46, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-5f9b2a5e-2f08-4b41-87f0-d457d9d0f147 req-e827398d-45d2-4cb1-add9-314abadf49db service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-unplugged-3016cdef-2342-41d7-af0a-feee127affa8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5f9b2a5e-2f08-4b41-87f0-d457d9d0f147 req-e827398d-45d2-4cb1-add9-314abadf49db service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5f9b2a5e-2f08-4b41-87f0-d457d9d0f147 req-e827398d-45d2-4cb1-add9-314abadf49db service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5f9b2a5e-2f08-4b41-87f0-d457d9d0f147 req-e827398d-45d2-4cb1-add9-314abadf49db service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-5f9b2a5e-2f08-4b41-87f0-d457d9d0f147 req-e827398d-45d2-4cb1-add9-314abadf49db service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-unplugged-3016cdef-2342-41d7-af0a-feee127affa8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-5f9b2a5e-2f08-4b41-87f0-d457d9d0f147 req-e827398d-45d2-4cb1-add9-314abadf49db service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-unplugged-3016cdef-2342-41d7-af0a-feee127affa8 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.network.neutron [req-08c93d45-b959-46b5-946a-4bff7d4b53eb req-c7aa939d-97b0-4ed6-822c-8b2219334995 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Updated VIF entry in instance network info cache for port 439b29b8-64e3-40fe-b28b-0f8e05155ab6. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.network.neutron [req-08c93d45-b959-46b5-946a-4bff7d4b53eb req-c7aa939d-97b0-4ed6-822c-8b2219334995 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Updating instance_info_cache with network_info: [{"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Instance destroyed successfully.
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lazy-loading 'resources' on Instance uuid bac3dbae-0134-450c-9220-0dd96e74aef0 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-08c93d45-b959-46b5-946a-4bff7d4b53eb req-c7aa939d-97b0-4ed6-822c-8b2219334995 service nova] Releasing lock "refresh_cache-18850651-02ac-459a-838c-b3216bcbe131" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-unplugged-81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-81da5d0c-cecc-40d5-b7d4-332741f3c96f for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:33 user nova-compute[73091]: WARNING nova.compute.manager [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-81da5d0c-cecc-40d5-b7d4-332741f3c96f for instance with vm_state active and task_state deleting.
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-unplugged-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-8d23ea29-e21c-45fb-a956-22f734a22384 req-236082e3-03df-4636-800e-11ec4cf7ea54 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:10:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "address": "fa:16:3e:26:bd:cb", "network": {"id": "1759d93e-5701-4061-b3b6-e192d31f3d94", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-648102261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81da5d0c-ce", "ovs_interfaceid": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "address": "fa:16:3e:26:bd:cb", "network": {"id": "1759d93e-5701-4061-b3b6-e192d31f3d94", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-648102261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81da5d0c-ce", "ovs_interfaceid": "81da5d0c-cecc-40d5-b7d4-332741f3c96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:bd:cb,bridge_name='br-int',has_traffic_filtering=True,id=81da5d0c-cecc-40d5-b7d4-332741f3c96f,network=Network(1759d93e-5701-4061-b3b6-e192d31f3d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81da5d0c-ce') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG os_vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:bd:cb,bridge_name='br-int',has_traffic_filtering=True,id=81da5d0c-cecc-40d5-b7d4-332741f3c96f,network=Network(1759d93e-5701-4061-b3b6-e192d31f3d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81da5d0c-ce') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81da5d0c-ce, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:33 user nova-compute[73091]: INFO os_vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:bd:cb,bridge_name='br-int',has_traffic_filtering=True,id=81da5d0c-cecc-40d5-b7d4-332741f3c96f,network=Network(1759d93e-5701-4061-b3b6-e192d31f3d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81da5d0c-ce')
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:10:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:96:78,bridge_name='br-int',has_traffic_filtering=True,id=45f2c112-2fab-4db9-8476-8639488f678a,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45f2c112-2f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG os_vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:96:78,bridge_name='br-int',has_traffic_filtering=True,id=45f2c112-2fab-4db9-8476-8639488f678a,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45f2c112-2f') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45f2c112-2f, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:33 user nova-compute[73091]: INFO os_vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:96:78,bridge_name='br-int',has_traffic_filtering=True,id=45f2c112-2fab-4db9-8476-8639488f678a,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45f2c112-2f')
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:10:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:71:2d,bridge_name='br-int',has_traffic_filtering=True,id=c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6ed638e-4f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG os_vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:71:2d,bridge_name='br-int',has_traffic_filtering=True,id=c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6ed638e-4f') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6ed638e-4f, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Instance destroyed successfully.
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lazy-loading 'resources' on Instance uuid 5b610a48-4130-48db-91af-0f3926ac775b {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2008915e-4e3b-4433-94c5-b837a4533e72", "address": "fa:16:3e:27:b1:72", "network": {"id": "08557a22-e386-4104-8e71-09e5287b1560", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-735103643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008915e-4e", "ovs_interfaceid": "2008915e-4e3b-4433-94c5-b837a4533e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "2008915e-4e3b-4433-94c5-b837a4533e72", "address": "fa:16:3e:27:b1:72", "network": {"id": "08557a22-e386-4104-8e71-09e5287b1560", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-735103643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008915e-4e", "ovs_interfaceid": "2008915e-4e3b-4433-94c5-b837a4533e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:b1:72,bridge_name='br-int',has_traffic_filtering=True,id=2008915e-4e3b-4433-94c5-b837a4533e72,network=Network(08557a22-e386-4104-8e71-09e5287b1560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2008915e-4e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG os_vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:b1:72,bridge_name='br-int',has_traffic_filtering=True,id=2008915e-4e3b-4433-94c5-b837a4533e72,network=Network(08557a22-e386-4104-8e71-09e5287b1560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2008915e-4e') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-45f2c112-2fab-4db9-8476-8639488f678a {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-45f2c112-2fab-4db9-8476-8639488f678a {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:34 user nova-compute[73091]: WARNING nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-45f2c112-2fab-4db9-8476-8639488f678a for instance with vm_state active and task_state deleting.
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-unplugged-c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:34 user nova-compute[73091]: WARNING nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8 for instance with vm_state active and task_state deleting.
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-e28992b9-adef-431a-8323-eff7c955648b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-unplugged-e28992b9-adef-431a-8323-eff7c955648b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-e28992b9-adef-431a-8323-eff7c955648b for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-e28992b9-adef-431a-8323-eff7c955648b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-e28992b9-adef-431a-8323-eff7c955648b {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:34 user nova-compute[73091]: WARNING nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-e28992b9-adef-431a-8323-eff7c955648b for instance with vm_state active and task_state deleting.
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-unplugged-2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-unplugged-2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-526cff03-72b4-4a03-82c5-a4579e9b12fb req-889b7dba-464d-46c7-ab69-9e16c7a2e0d0 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-unplugged-2008915e-4e3b-4433-94c5-b837a4533e72 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2008915e-4e, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:34 user nova-compute[73091]: INFO os_vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:71:2d,bridge_name='br-int',has_traffic_filtering=True,id=c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6ed638e-4f')
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:10:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "address": "fa:16:3e:0c:14:b8", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404c0ed4-2b", "ovs_interfaceid": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "address": "fa:16:3e:0c:14:b8", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404c0ed4-2b", "ovs_interfaceid": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=404c0ed4-2bc5-4608-8a0e-4f71a08c7b74,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404c0ed4-2b') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG os_vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=404c0ed4-2bc5-4608-8a0e-4f71a08c7b74,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404c0ed4-2b') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap404c0ed4-2b, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: INFO os_vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:b1:72,bridge_name='br-int',has_traffic_filtering=True,id=2008915e-4e3b-4433-94c5-b837a4533e72,network=Network(08557a22-e386-4104-8e71-09e5287b1560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2008915e-4e')
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98aea5dd-a8b3-493c-88b7-39b279a71065", "address": "fa:16:3e:2e:16:79", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aea5dd-a8", "ovs_interfaceid": "98aea5dd-a8b3-493c-88b7-39b279a71065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "98aea5dd-a8b3-493c-88b7-39b279a71065", "address": "fa:16:3e:2e:16:79", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aea5dd-a8", "ovs_interfaceid": "98aea5dd-a8b3-493c-88b7-39b279a71065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:16:79,bridge_name='br-int',has_traffic_filtering=True,id=98aea5dd-a8b3-493c-88b7-39b279a71065,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98aea5dd-a8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG os_vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:16:79,bridge_name='br-int',has_traffic_filtering=True,id=98aea5dd-a8b3-493c-88b7-39b279a71065,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98aea5dd-a8') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98aea5dd-a8, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: INFO os_vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=404c0ed4-2bc5-4608-8a0e-4f71a08c7b74,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap404c0ed4-2b')
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:10:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:28:16,bridge_name='br-int',has_traffic_filtering=True,id=e28992b9-adef-431a-8323-eff7c955648b,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28992b9-ad') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG os_vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:28:16,bridge_name='br-int',has_traffic_filtering=True,id=e28992b9-adef-431a-8323-eff7c955648b,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28992b9-ad') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape28992b9-ad, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: INFO os_vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:16:79,bridge_name='br-int',has_traffic_filtering=True,id=98aea5dd-a8b3-493c-88b7-39b279a71065,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98aea5dd-a8')
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "address": "fa:16:3e:c1:b6:6b", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6f6e98-0c", "ovs_interfaceid": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "address": "fa:16:3e:c1:b6:6b", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6f6e98-0c", "ovs_interfaceid": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b6:6b,bridge_name='br-int',has_traffic_filtering=True,id=3c6f6e98-0c46-4f70-b579-6dfb0d9fb684,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c6f6e98-0c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG os_vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b6:6b,bridge_name='br-int',has_traffic_filtering=True,id=3c6f6e98-0c46-4f70-b579-6dfb0d9fb684,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c6f6e98-0c') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c6f6e98-0c, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:34 user nova-compute[73091]: INFO os_vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:28:16,bridge_name='br-int',has_traffic_filtering=True,id=e28992b9-adef-431a-8323-eff7c955648b,network=Network(315ec70b-c22c-4b2c-9371-c54695e03e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28992b9-ad')
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:10:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "address": "fa:16:3e:09:f9:0a", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c3edd9-64", "ovs_interfaceid": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "address": "fa:16:3e:09:f9:0a", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c3edd9-64", "ovs_interfaceid": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=95c3edd9-641c-4059-9d3f-553918cf9a2e,network=Network(91679214-2ee2-419f-8daf-b712380c2fb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c3edd9-64') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG os_vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=95c3edd9-641c-4059-9d3f-553918cf9a2e,network=Network(91679214-2ee2-419f-8daf-b712380c2fb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c3edd9-64') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95c3edd9-64, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:34 user nova-compute[73091]: INFO os_vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b6:6b,bridge_name='br-int',has_traffic_filtering=True,id=3c6f6e98-0c46-4f70-b579-6dfb0d9fb684,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c6f6e98-0c')
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "address": "fa:16:3e:98:9d:73", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12399afc-df", "ovs_interfaceid": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "address": "fa:16:3e:98:9d:73", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12399afc-df", "ovs_interfaceid": "12399afc-df8c-4c43-bf0f-20b6e8d16f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:73,bridge_name='br-int',has_traffic_filtering=True,id=12399afc-df8c-4c43-bf0f-20b6e8d16f12,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12399afc-df') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG os_vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:73,bridge_name='br-int',has_traffic_filtering=True,id=12399afc-df8c-4c43-bf0f-20b6e8d16f12,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12399afc-df') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc17db3f-421a-44ad-bb23-95bdf335f328 req-73590998-8660-44a5-82a5-57a2d7153f08 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-3016cdef-2342-41d7-af0a-feee127affa8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc17db3f-421a-44ad-bb23-95bdf335f328 req-73590998-8660-44a5-82a5-57a2d7153f08 service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc17db3f-421a-44ad-bb23-95bdf335f328 req-73590998-8660-44a5-82a5-57a2d7153f08 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc17db3f-421a-44ad-bb23-95bdf335f328 req-73590998-8660-44a5-82a5-57a2d7153f08 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc17db3f-421a-44ad-bb23-95bdf335f328 req-73590998-8660-44a5-82a5-57a2d7153f08 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-3016cdef-2342-41d7-af0a-feee127affa8 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:34 user nova-compute[73091]: WARNING nova.compute.manager [req-cc17db3f-421a-44ad-bb23-95bdf335f328 req-73590998-8660-44a5-82a5-57a2d7153f08 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-3016cdef-2342-41d7-af0a-feee127affa8 for instance with vm_state active and task_state deleting.
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12399afc-df, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: INFO os_vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=95c3edd9-641c-4059-9d3f-553918cf9a2e,network=Network(91679214-2ee2-419f-8daf-b712380c2fb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c3edd9-64')
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-452584988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-452584988',id=11,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGCXbK/3/NjfhqnDLFc5/ILZeMN5ac9okUe3KUR+pLKAUErH53J9a8fVoR0KxYclLZFC5sp0U6DJwtl9wJxwp3Sbl5/D6LDBD9r8ZPW16RnZd574BI2OuVomdz09cKAGA==',key_name='tempest-keypair-1572685652',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:10:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbad0cbebaa4c47993c46da30699728',ramdisk_id='',reservation_id='r-p0o7zj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1352082067',owner_user_name='tempest-TaggedBootDevicesTest_v242-1352082067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:10:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6aeb7656f3448f9ab9e18953f30432',uuid=bac3dbae-0134-450c-9220-0dd96e74aef0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2725555-04ce-4049-ad18-6c7164352ea0", "address": "fa:16:3e:7f:c1:00", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2725555-04", "ovs_interfaceid": "b2725555-04ce-4049-ad18-6c7164352ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converting VIF {"id": "b2725555-04ce-4049-ad18-6c7164352ea0", "address": "fa:16:3e:7f:c1:00", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2725555-04", "ovs_interfaceid": "b2725555-04ce-4049-ad18-6c7164352ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c1:00,bridge_name='br-int',has_traffic_filtering=True,id=b2725555-04ce-4049-ad18-6c7164352ea0,network=Network(91679214-2ee2-419f-8daf-b712380c2fb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2725555-04') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG os_vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c1:00,bridge_name='br-int',has_traffic_filtering=True,id=b2725555-04ce-4049-ad18-6c7164352ea0,network=Network(91679214-2ee2-419f-8daf-b712380c2fb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2725555-04') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2725555-04, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:34 user nova-compute[73091]: INFO os_vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:73,bridge_name='br-int',has_traffic_filtering=True,id=12399afc-df8c-4c43-bf0f-20b6e8d16f12,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12399afc-df')
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "address": "fa:16:3e:97:e5:41", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f21c70-35", "ovs_interfaceid": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "address": "fa:16:3e:97:e5:41", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f21c70-35", "ovs_interfaceid": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:e5:41,bridge_name='br-int',has_traffic_filtering=True,id=55f21c70-3596-4c1f-9688-d1c03967e6c0,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f21c70-35') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG os_vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:e5:41,bridge_name='br-int',has_traffic_filtering=True,id=55f21c70-3596-4c1f-9688-d1c03967e6c0,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f21c70-35') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55f21c70-35, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:35 user nova-compute[73091]: INFO os_vif [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c1:00,bridge_name='br-int',has_traffic_filtering=True,id=b2725555-04ce-4049-ad18-6c7164352ea0,network=Network(91679214-2ee2-419f-8daf-b712380c2fb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2725555-04')
Aug 16 08:12:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:35 user nova-compute[73091]: INFO os_vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:e5:41,bridge_name='br-int',has_traffic_filtering=True,id=55f21c70-3596-4c1f-9688-d1c03967e6c0,network=Network(c2b71937-211f-4709-ab31-4c3b9625dc30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f21c70-35')
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3016cdef-2342-41d7-af0a-feee127affa8", "address": "fa:16:3e:3c:0a:32", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3016cdef-23", "ovs_interfaceid": "3016cdef-2342-41d7-af0a-feee127affa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "3016cdef-2342-41d7-af0a-feee127affa8", "address": "fa:16:3e:3c:0a:32", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3016cdef-23", "ovs_interfaceid": "3016cdef-2342-41d7-af0a-feee127affa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:0a:32,bridge_name='br-int',has_traffic_filtering=True,id=3016cdef-2342-41d7-af0a-feee127affa8,network=Network(d1508b84-5f7e-474d-b85a-1488dc467b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3016cdef-23') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:0a:32,bridge_name='br-int',has_traffic_filtering=True,id=3016cdef-2342-41d7-af0a-feee127affa8,network=Network(d1508b84-5f7e-474d-b85a-1488dc467b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3016cdef-23') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJnsbEul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:12:35 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3016cdef-23, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:35 user nova-compute[73091]: INFO os_vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:0a:32,bridge_name='br-int',has_traffic_filtering=True,id=3016cdef-2342-41d7-af0a-feee127affa8,network=Network(d1508b84-5f7e-474d-b85a-1488dc467b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3016cdef-23')
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-369925601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-369925601',id=12,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4TCf7NmmoIoHyJ6HxFtsbFLxYS9MtBmuj675XasluqKGPJRZqJ69QW7Amt0jFdrKpD0g6x/yuliIZxxi1OQlFlMShWleYm04Cc15n3HR39ysh7C9tfb5H3KuTU6HXLA==',key_name='tempest-keypair-1761743000',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4ab62fd66c14cab96934322638feca6',ramdisk_id='',reservation_id='r-01hh9aj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1126604454',owner_user_name='tempest-TaggedBootDevicesTest-1126604454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4180033cfe414478a8d71b7eab618f30',uuid=5b610a48-4130-48db-91af-0f3926ac775b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "address": "fa:16:3e:35:54:2d", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13190e58-60", "ovs_interfaceid": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converting VIF {"id": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "address": "fa:16:3e:35:54:2d", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13190e58-60", "ovs_interfaceid": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:54:2d,bridge_name='br-int',has_traffic_filtering=True,id=13190e58-602a-4b42-b35d-c5d977e0cbb9,network=Network(d1508b84-5f7e-474d-b85a-1488dc467b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13190e58-60') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:54:2d,bridge_name='br-int',has_traffic_filtering=True,id=13190e58-602a-4b42-b35d-c5d977e0cbb9,network=Network(d1508b84-5f7e-474d-b85a-1488dc467b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13190e58-60') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c280995-c3dd-4b47-b7e5-9700ba1a76d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13190e58-60, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:35 user nova-compute[73091]: INFO os_vif [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:54:2d,bridge_name='br-int',has_traffic_filtering=True,id=13190e58-602a-4b42-b35d-c5d977e0cbb9,network=Network(d1508b84-5f7e-474d-b85a-1488dc467b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13190e58-60')
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krOtefGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:12:35 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bda3c28-0d63-48a4-ac7c-a89864ca452b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8f04ab7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:35 user nova-compute[73091]: WARNING nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 for instance with vm_state active and task_state deleting.
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-95c3edd9-641c-4059-9d3f-553918cf9a2e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-unplugged-95c3edd9-641c-4059-9d3f-553918cf9a2e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-95c3edd9-641c-4059-9d3f-553918cf9a2e for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-95c3edd9-641c-4059-9d3f-553918cf9a2e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-95c3edd9-641c-4059-9d3f-553918cf9a2e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:35 user nova-compute[73091]: WARNING nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-95c3edd9-641c-4059-9d3f-553918cf9a2e for instance with vm_state active and task_state deleting.
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-unplugged-13190e58-602a-4b42-b35d-c5d977e0cbb9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-unplugged-13190e58-602a-4b42-b35d-c5d977e0cbb9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-unplugged-13190e58-602a-4b42-b35d-c5d977e0cbb9 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-13190e58-602a-4b42-b35d-c5d977e0cbb9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-13190e58-602a-4b42-b35d-c5d977e0cbb9 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:35 user nova-compute[73091]: WARNING nova.compute.manager [req-04c1f35f-bb3b-4acd-a228-b5bf9d408e87 req-b78ab28a-a7a8-4b6d-8112-2bbb13a421ca service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-13190e58-602a-4b42-b35d-c5d977e0cbb9 for instance with vm_state active and task_state deleting.
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6717cc28-8f22-4664-80d1-d05c6140e693]: (4, ('path checker states:\nup                  6\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd440dca-e1c8-401b-b59c-e9a37b3edad1]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5378022-f8eb-4afc-b60f-2dba3d7d5afc]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0354e59a-30b1-40f9-8ba8-9ff469fa2b1d]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38ed2f8-6f8d-4a7e-afd3-438288bb192b]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[975d57cd-e0c0-479a-8e2d-4e952abd6e7c]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091, portal: 172.16.0.220,3260]
Aug 16 08:12:35 user nova-compute[73091]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091, portal: 172.16.0.220,3260] successful.
Aug 16 08:12:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9756d7-906f-48fe-abfa-5b1445639091 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb73f61-db03-4534-8a69-2e063fde7f05]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] <== disconnect_volume: return (365ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.321s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmDueGSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:12:35 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea19281-aa7f-46af-9eac-7530bd67c55b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1b6f2c-5aff-4a0a-8b64-169005c3160c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8cc58e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b98f4b-ab9c-4058-b88b-1b54d75d9faa]: (4, ('path checker states:\nup                  5\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db4f37c-0c0c-46fa-bb93-f7e0497e9715]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d712d2-8f1e-48ca-a9c0-62aac533ae17]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9642a4e-f9a6-4b60-a5da-43dfe9d2cba7]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d97980-3eab-4100-bdb5-13238f928602]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a889f5c5-2898-44b9-8b5b-fd0d18da136a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680, portal: 172.16.0.220,3260]
Aug 16 08:12:35 user nova-compute[73091]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680, portal: 172.16.0.220,3260] successful.
Aug 16 08:12:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369fe995-f701-42e3-92e9-fcbc3c536680 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[620d4e3c-0f83-4a6c-9ef1-945628729449]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] <== disconnect_volume: return (641ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.316s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYziSaWI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:12:35 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc36cb69-479c-4b39-81f7-81226ef7d03f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c3aef9-9c75-4a7e-bc6e-c35d933e6a78]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 (non-flash)
Aug 16 08:12:35 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8f065dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004'): ({'sdg'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Removing single pathed devices sdg {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf131e03-1b7c-4caa-a42a-b00eb2738559]: (4, ('path checker states:\nup                  4\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[024e4718-a59b-4a79-ba67-79f4b28ade4d]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Flushing IO for device /dev/sdg {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a9ab4c-522e-4376-b9e7-f3a867758a7a]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69ced7a-18ff-4e49-a0aa-4753cae3176a]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] SCSI volumes sdg have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac03b44d-5b84-4828-9c0e-cad13631d03c]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fe0e18-3949-425e-bb01-6c05fdfa2442]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004, portal: 172.16.0.220,3260]
Aug 16 08:12:35 user nova-compute[73091]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004, portal: 172.16.0.220,3260] successful.
Aug 16 08:12:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d731c5-4324-4acd-85bf-9e9829071004 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[707c75b7-d294-47dd-95c0-a368a1e671ea]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] <== disconnect_volume: return (627ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.309s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsRcZlim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:12:36 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e5fab4-d4d0-45d5-8031-28210424b11b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b6ec4f-2517-49ca-b47d-81477b9f7d99]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8f065dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Removing single pathed devices sdf {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6eddd7-757c-400a-84af-72128b5b59f7]: (4, ('path checker states:\nup                  3\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:36 user nova-compute[73091]: WARNING nova.compute.manager [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-2008915e-4e3b-4433-94c5-b837a4533e72 for instance with vm_state active and task_state deleting.
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-unplugged-98aea5dd-a8b3-493c-88b7-39b279a71065 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-unplugged-98aea5dd-a8b3-493c-88b7-39b279a71065 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-unplugged-98aea5dd-a8b3-493c-88b7-39b279a71065 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-98aea5dd-a8b3-493c-88b7-39b279a71065 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-98aea5dd-a8b3-493c-88b7-39b279a71065 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:36 user nova-compute[73091]: WARNING nova.compute.manager [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-98aea5dd-a8b3-493c-88b7-39b279a71065 for instance with vm_state active and task_state deleting.
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-unplugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-fb365fc8-65a3-488c-a26d-f7057f1339d4 req-de9b9a54-952d-45af-9e34-4b7f8b1bec7d service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-b2725555-04ce-4049-ad18-6c7164352ea0 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[05640340-ba7d-488f-a0d0-52902b80aa3e]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2154ca-170c-4e8e-a856-048662bdabe5]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ae3d13-36c5-4712-8de0-599646b3692f]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bfc434-4239-45d8-9ed8-755ed2c3e187]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cef4c1-1743-43f8-b457-94b80f3f41ab]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1, portal: 172.16.0.220,3260]
Aug 16 08:12:36 user nova-compute[73091]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1, portal: 172.16.0.220,3260] successful.
Aug 16 08:12:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c4295bb-295f-4da8-bc40-72722984a3a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e193655-c338-493f-bdfe-5c03b9504be0]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] <== disconnect_volume: return (640ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.329s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KkiIdfsY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:12:36 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed66abcd-116b-4875-8079-6e4dcb549acf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab847af9-0ba4-4528-9675-660a139f404a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8f065dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a370ddb-1c9c-444b-967a-7582ef8d614a]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7754af22-0043-4965-95b2-3d766a0efd6a]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd37203-1c36-4c18-ac07-23744e54248a]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[461d39bd-d7df-4816-b8f1-77ec9d0b9d8d]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f8ad6c-0459-40d6-b402-99241a5c3fb2]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[72adfb94-a2cb-4d82-94d4-f8605ea9054d]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f, portal: 172.16.0.220,3260]
Aug 16 08:12:36 user nova-compute[73091]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f, portal: 172.16.0.220,3260] successful.
Aug 16 08:12:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b645720c-dcf4-4304-98c8-f3ecb834612f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bbdd09-a6f3-41c7-b09c-509e825058e6]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] <== disconnect_volume: return (667ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:12:36 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Deleting instance files /opt/stack/data/nova/instances/bac3dbae-0134-450c-9220-0dd96e74aef0_del
Aug 16 08:12:36 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Deletion of /opt/stack/data/nova/instances/bac3dbae-0134-450c-9220-0dd96e74aef0_del complete
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.339s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ab66b8-ed85-4c9d-abb5-1572a97bd9c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dc13ff-61d4-4831-83a4-358545032427]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:36 user nova-compute[73091]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc (non-flash)
Aug 16 08:12:36 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8f05be950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc'): ({'sdh'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Removing single pathed devices sdh {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2f5b80-6c03-4287-91dd-571c769d3938]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: INFO nova.compute.manager [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Took 5.77 seconds to destroy the instance on the hypervisor.
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e7ae73-c746-430a-95e9-9c163b73c6a7]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Flushing IO for device /dev/sdh {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed1864a-dbc1-4169-9b3e-9730b0bad8dc]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.055s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcf1246-061d-4b04-a0c7-805d9bb6c3d3]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] SCSI volumes sdh have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae2509e-7a66-424c-8f6d-8d907f656188]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173556.9441762, 18850651-02ac-459a-838c-b3216bcbe131 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:12:36 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] VM Resumed (Lifecycle Event)
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:12:36 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Instance spawned successfully.
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:12:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8138a2cb-87ce-436b-acb4-e1124e589956]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc, portal: 172.16.0.220,3260]
Aug 16 08:12:37 user nova-compute[73091]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc, portal: 172.16.0.220,3260] successful.
Aug 16 08:12:37 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:37 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:12:37 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173556.9483883, 18850651-02ac-459a-838c-b3216bcbe131 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:12:37 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] VM Started (Lifecycle Event)
Aug 16 08:12:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af07271b-6693-42cb-bee0-00e7417be1bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2d6165-9e94-4981-9001-4d54d2b64e40]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] <== disconnect_volume: return (672ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:12:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Deleting instance files /opt/stack/data/nova/instances/5b610a48-4130-48db-91af-0f3926ac775b_del
Aug 16 08:12:37 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Deletion of /opt/stack/data/nova/instances/5b610a48-4130-48db-91af-0f3926ac775b_del complete
Aug 16 08:12:37 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:12:37 user nova-compute[73091]: INFO nova.compute.manager [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Took 9.76 seconds to spawn the instance on the hypervisor.
Aug 16 08:12:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:12:37 user nova-compute[73091]: INFO nova.compute.manager [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Took 5.57 seconds to destroy the instance on the hypervisor.
Aug 16 08:12:37 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 08:12:37 user nova-compute[73091]: INFO nova.compute.manager [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Took 10.82 seconds to build instance.
Aug 16 08:12:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8cfff31c-4e62-4e89-8a27-7d4f0b856880 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "18850651-02ac-459a-838c-b3216bcbe131" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.946s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:38 user nova-compute[73091]: WARNING nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 for instance with vm_state active and task_state deleting.
Aug 16 08:12:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-unplugged-12399afc-df8c-4c43-bf0f-20b6e8d16f12 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-unplugged-12399afc-df8c-4c43-bf0f-20b6e8d16f12 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-unplugged-12399afc-df8c-4c43-bf0f-20b6e8d16f12 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-12399afc-df8c-4c43-bf0f-20b6e8d16f12 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-12399afc-df8c-4c43-bf0f-20b6e8d16f12 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:38 user nova-compute[73091]: WARNING nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-12399afc-df8c-4c43-bf0f-20b6e8d16f12 for instance with vm_state active and task_state deleting.
Aug 16 08:12:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-unplugged-3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-unplugged-3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-unplugged-3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:38 user nova-compute[73091]: WARNING nova.compute.manager [req-7354f7a0-a7ac-4361-b7a1-1b74f8ac7ffa req-6f933491-d291-411a-97da-37754e7f7cf4 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-3c6f6e98-0c46-4f70-b579-6dfb0d9fb684 for instance with vm_state active and task_state deleting.
Aug 16 08:12:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-unplugged-55f21c70-3596-4c1f-9688-d1c03967e6c0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-unplugged-55f21c70-3596-4c1f-9688-d1c03967e6c0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-unplugged-55f21c70-3596-4c1f-9688-d1c03967e6c0 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-plugged-55f21c70-3596-4c1f-9688-d1c03967e6c0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Acquiring lock "5b610a48-4130-48db-91af-0f3926ac775b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Lock "5b610a48-4130-48db-91af-0f3926ac775b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] No waiting events found dispatching network-vif-plugged-55f21c70-3596-4c1f-9688-d1c03967e6c0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:40 user nova-compute[73091]: WARNING nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received unexpected event network-vif-plugged-55f21c70-3596-4c1f-9688-d1c03967e6c0 for instance with vm_state active and task_state deleting.
Aug 16 08:12:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:40 user nova-compute[73091]: WARNING nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 for instance with vm_state active and task_state deleting.
Aug 16 08:12:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:40 user nova-compute[73091]: WARNING nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 for instance with vm_state active and task_state deleting.
Aug 16 08:12:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-unplugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-60621769-09c6-4b7d-b928-739c558d2a31 req-73ba4338-6abd-4cf9-9417-07ca6917bcd0 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-unplugged-b2725555-04ce-4049-ad18-6c7164352ea0 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-5551e45a-5cc5-484a-82b1-93ae6010e780 req-28ab8d44-3220-4391-838f-174d293c1dcd service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-deleted-81da5d0c-cecc-40d5-b7d4-332741f3c96f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:41 user nova-compute[73091]: INFO nova.compute.manager [req-5551e45a-5cc5-484a-82b1-93ae6010e780 req-28ab8d44-3220-4391-838f-174d293c1dcd service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Neutron deleted interface 81da5d0c-cecc-40d5-b7d4-332741f3c96f; detaching it from the instance and deleting it from the info cache
Aug 16 08:12:41 user nova-compute[73091]: DEBUG nova.network.neutron [req-5551e45a-5cc5-484a-82b1-93ae6010e780 req-28ab8d44-3220-4391-838f-174d293c1dcd service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating instance_info_cache with network_info: [{"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "address": "fa:16:3e:0c:14:b8", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap404c0ed4-2b", "ovs_interfaceid": "404c0ed4-2bc5-4608-8a0e-4f71a08c7b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "address": "fa:16:3e:09:f9:0a", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c3edd9-64", "ovs_interfaceid": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2725555-04ce-4049-ad18-6c7164352ea0", "address": "fa:16:3e:7f:c1:00", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2725555-04", "ovs_interfaceid": "b2725555-04ce-4049-ad18-6c7164352ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-5551e45a-5cc5-484a-82b1-93ae6010e780 req-28ab8d44-3220-4391-838f-174d293c1dcd service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Detach interface failed, port_id=81da5d0c-cecc-40d5-b7d4-332741f3c96f, reason: Instance bac3dbae-0134-450c-9220-0dd96e74aef0 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 08:12:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] Acquiring lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] No waiting events found dispatching network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:42 user nova-compute[73091]: WARNING nova.compute.manager [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received unexpected event network-vif-plugged-b2725555-04ce-4049-ad18-6c7164352ea0 for instance with vm_state active and task_state deleting.
Aug 16 08:12:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received event network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] No waiting events found dispatching network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:42 user nova-compute[73091]: WARNING nova.compute.manager [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received unexpected event network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 for instance with vm_state active and task_state None.
Aug 16 08:12:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received event network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] No waiting events found dispatching network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:42 user nova-compute[73091]: WARNING nova.compute.manager [req-f01db1b2-174e-4316-9c69-3cd1230dbe4e req-4f1f26bc-51f7-4790-b7c7-31a86bd73525 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received unexpected event network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 for instance with vm_state active and task_state None.
Aug 16 08:12:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQVAUtDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:12:42 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:12:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:12:42 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:12:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:12:42 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd220ab-197a-4c59-a70a-41a6aa57965a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:12:42 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d834df9-7de2-4fae-81a3-30d154d9c0fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c] added
Aug 16 08:12:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be82447-e2ba-4b24-a280-692c0f3066f8]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b4f2a1-edbe-4a72-adc4-98de54b120f9]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQVAUtDu {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQVAUtDu" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b703b7-38fb-41eb-bf22-88e91064293d]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FQVAUtDu'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefff3c4-4b93-4ace-892d-dd6252bda519]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3efc83f-e3fa-43dc-8004-1b7d828ef168]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:42 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:42 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:12:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a50960d-5907-4bca-9273-6eada2665d79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260]
Aug 16 08:12:43 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260] successful.
Aug 16 08:12:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d4374e-796d-4eb2-a77c-0df43e3b80db]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a343d6db-02fb-4735-b47a-bbd24cefaae3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:43 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:43 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:12:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:43 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:43 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:12:43 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[256cdedc-77a9-457d-bb2a-e82ff3bb87c1]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQVAUtDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-8ed6fd85-1107-4f73-8392-2f712f0d6bc0 req-accf5af9-f8f6-447b-8c0c-0c12a6b36d6d service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-deleted-12399afc-df8c-4c43-bf0f-20b6e8d16f12 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:43 user nova-compute[73091]: INFO nova.compute.manager [req-8ed6fd85-1107-4f73-8392-2f712f0d6bc0 req-accf5af9-f8f6-447b-8c0c-0c12a6b36d6d service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Neutron deleted interface 12399afc-df8c-4c43-bf0f-20b6e8d16f12; detaching it from the instance and deleting it from the info cache
Aug 16 08:12:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-8ed6fd85-1107-4f73-8392-2f712f0d6bc0 req-accf5af9-f8f6-447b-8c0c-0c12a6b36d6d service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating instance_info_cache with network_info: [{"id": "2008915e-4e3b-4433-94c5-b837a4533e72", "address": "fa:16:3e:27:b1:72", "network": {"id": "08557a22-e386-4104-8e71-09e5287b1560", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-735103643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008915e-4e", "ovs_interfaceid": "2008915e-4e3b-4433-94c5-b837a4533e72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98aea5dd-a8b3-493c-88b7-39b279a71065", "address": "fa:16:3e:2e:16:79", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aea5dd-a8", "ovs_interfaceid": "98aea5dd-a8b3-493c-88b7-39b279a71065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "address": "fa:16:3e:c1:b6:6b", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6f6e98-0c", "ovs_interfaceid": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "address": "fa:16:3e:97:e5:41", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f21c70-35", "ovs_interfaceid": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3016cdef-2342-41d7-af0a-feee127affa8", "address": "fa:16:3e:3c:0a:32", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3016cdef-23", "ovs_interfaceid": "3016cdef-2342-41d7-af0a-feee127affa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "address": "fa:16:3e:35:54:2d", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13190e58-60", "ovs_interfaceid": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-8ed6fd85-1107-4f73-8392-2f712f0d6bc0 req-accf5af9-f8f6-447b-8c0c-0c12a6b36d6d service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Detach interface failed, port_id=12399afc-df8c-4c43-bf0f-20b6e8d16f12, reason: Instance 5b610a48-4130-48db-91af-0f3926ac775b could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-8ed6fd85-1107-4f73-8392-2f712f0d6bc0 req-accf5af9-f8f6-447b-8c0c-0c12a6b36d6d service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-deleted-404c0ed4-2bc5-4608-8a0e-4f71a08c7b74 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:43 user nova-compute[73091]: INFO nova.compute.manager [req-8ed6fd85-1107-4f73-8392-2f712f0d6bc0 req-accf5af9-f8f6-447b-8c0c-0c12a6b36d6d service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Neutron deleted interface 404c0ed4-2bc5-4608-8a0e-4f71a08c7b74; detaching it from the instance and deleting it from the info cache
Aug 16 08:12:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-8ed6fd85-1107-4f73-8392-2f712f0d6bc0 req-accf5af9-f8f6-447b-8c0c-0c12a6b36d6d service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating instance_info_cache with network_info: [{"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "address": "fa:16:3e:09:f9:0a", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c3edd9-64", "ovs_interfaceid": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2725555-04ce-4049-ad18-6c7164352ea0", "address": "fa:16:3e:7f:c1:00", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2725555-04", "ovs_interfaceid": "b2725555-04ce-4049-ad18-6c7164352ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-8ed6fd85-1107-4f73-8392-2f712f0d6bc0 req-accf5af9-f8f6-447b-8c0c-0c12a6b36d6d service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Detach interface failed, port_id=404c0ed4-2bc5-4608-8a0e-4f71a08c7b74, reason: Instance bac3dbae-0134-450c-9220-0dd96e74aef0 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-8ed6fd85-1107-4f73-8392-2f712f0d6bc0 req-accf5af9-f8f6-447b-8c0c-0c12a6b36d6d service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-deleted-b2725555-04ce-4049-ad18-6c7164352ea0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:43 user nova-compute[73091]: INFO nova.compute.manager [req-8ed6fd85-1107-4f73-8392-2f712f0d6bc0 req-accf5af9-f8f6-447b-8c0c-0c12a6b36d6d service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Neutron deleted interface b2725555-04ce-4049-ad18-6c7164352ea0; detaching it from the instance and deleting it from the info cache
Aug 16 08:12:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-8ed6fd85-1107-4f73-8392-2f712f0d6bc0 req-accf5af9-f8f6-447b-8c0c-0c12a6b36d6d service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating instance_info_cache with network_info: [{"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "address": "fa:16:3e:09:f9:0a", "network": {"id": "91679214-2ee2-419f-8daf-b712380c2fb5", "bridge": "br-int", "label": "tempest-device-tagging-net2-2026175423", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c3edd9-64", "ovs_interfaceid": "95c3edd9-641c-4059-9d3f-553918cf9a2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-8ed6fd85-1107-4f73-8392-2f712f0d6bc0 req-accf5af9-f8f6-447b-8c0c-0c12a6b36d6d service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Detach interface failed, port_id=b2725555-04ce-4049-ad18-6c7164352ea0, reason: Instance bac3dbae-0134-450c-9220-0dd96e74aef0 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 08:12:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:12:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26435303336653430', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:12:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435303336653430', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:12:44 user nova-compute[73091]: DEBUG nova.objects.instance [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lazy-loading 'flavor' on Instance uuid 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:12:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 08:12:44 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:12:44 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 08:12:44 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:12:44 user nova-compute[73091]:   <serial>0f37e5a8-0be3-43d7-bff6-390364c5e37c</serial>
Aug 16 08:12:44 user nova-compute[73091]: </disk>
Aug 16 08:12:44 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 08:12:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:12:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:12:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] No VIF found with MAC fa:16:3e:58:35:e3, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:12:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a5c7fb11-ef14-41c4-88a1-cb22f9656375 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "476de8ea-30dd-4b52-be37-f134e445757f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.937s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "7aded393-c408-48d9-a30c-78b62ce0d09e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:12:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-c8d5d0e8-5600-4364-9b30-3061038050d2 req-600a2ab2-9213-453d-ac1d-b04bc9ef3745 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-deleted-2008915e-4e3b-4433-94c5-b837a4533e72 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:45 user nova-compute[73091]: INFO nova.compute.manager [req-c8d5d0e8-5600-4364-9b30-3061038050d2 req-600a2ab2-9213-453d-ac1d-b04bc9ef3745 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Neutron deleted interface 2008915e-4e3b-4433-94c5-b837a4533e72; detaching it from the instance and deleting it from the info cache
Aug 16 08:12:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-c8d5d0e8-5600-4364-9b30-3061038050d2 req-600a2ab2-9213-453d-ac1d-b04bc9ef3745 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating instance_info_cache with network_info: [{"id": "98aea5dd-a8b3-493c-88b7-39b279a71065", "address": "fa:16:3e:2e:16:79", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aea5dd-a8", "ovs_interfaceid": "98aea5dd-a8b3-493c-88b7-39b279a71065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "address": "fa:16:3e:c1:b6:6b", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6f6e98-0c", "ovs_interfaceid": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "address": "fa:16:3e:97:e5:41", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f21c70-35", "ovs_interfaceid": "55f21c70-3596-4c1f-9688-d1c03967e6c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3016cdef-2342-41d7-af0a-feee127affa8", "address": "fa:16:3e:3c:0a:32", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3016cdef-23", "ovs_interfaceid": "3016cdef-2342-41d7-af0a-feee127affa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "address": "fa:16:3e:35:54:2d", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13190e58-60", "ovs_interfaceid": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:45 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:12:45 user nova-compute[73091]: INFO nova.compute.claims [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Claim successful on node user
Aug 16 08:12:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-c8d5d0e8-5600-4364-9b30-3061038050d2 req-600a2ab2-9213-453d-ac1d-b04bc9ef3745 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Detach interface failed, port_id=2008915e-4e3b-4433-94c5-b837a4533e72, reason: Instance 5b610a48-4130-48db-91af-0f3926ac775b could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 08:12:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-c8d5d0e8-5600-4364-9b30-3061038050d2 req-600a2ab2-9213-453d-ac1d-b04bc9ef3745 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-deleted-95c3edd9-641c-4059-9d3f-553918cf9a2e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:45 user nova-compute[73091]: INFO nova.compute.manager [req-c8d5d0e8-5600-4364-9b30-3061038050d2 req-600a2ab2-9213-453d-ac1d-b04bc9ef3745 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Neutron deleted interface 95c3edd9-641c-4059-9d3f-553918cf9a2e; detaching it from the instance and deleting it from the info cache
Aug 16 08:12:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-c8d5d0e8-5600-4364-9b30-3061038050d2 req-600a2ab2-9213-453d-ac1d-b04bc9ef3745 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating instance_info_cache with network_info: [{"id": "45f2c112-2fab-4db9-8476-8639488f678a", "address": "fa:16:3e:27:96:78", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f2c112-2f", "ovs_interfaceid": "45f2c112-2fab-4db9-8476-8639488f678a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "address": "fa:16:3e:57:71:2d", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6ed638e-4f", "ovs_interfaceid": "c6ed638e-4ff5-4dc4-9f0a-c1392057e3b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e28992b9-adef-431a-8323-eff7c955648b", "address": "fa:16:3e:0d:28:16", "network": {"id": "315ec70b-c22c-4b2c-9371-c54695e03e07", "bridge": "br-int", "label": "tempest-device-tagging-net1-275040601", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cbad0cbebaa4c47993c46da30699728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28992b9-ad", "ovs_interfaceid": "e28992b9-adef-431a-8323-eff7c955648b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-c8d5d0e8-5600-4364-9b30-3061038050d2 req-600a2ab2-9213-453d-ac1d-b04bc9ef3745 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Detach interface failed, port_id=95c3edd9-641c-4059-9d3f-553918cf9a2e, reason: Instance bac3dbae-0134-450c-9220-0dd96e74aef0 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 08:12:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-c8d5d0e8-5600-4364-9b30-3061038050d2 req-600a2ab2-9213-453d-ac1d-b04bc9ef3745 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-deleted-55f21c70-3596-4c1f-9688-d1c03967e6c0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:45 user nova-compute[73091]: INFO nova.compute.manager [req-c8d5d0e8-5600-4364-9b30-3061038050d2 req-600a2ab2-9213-453d-ac1d-b04bc9ef3745 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Neutron deleted interface 55f21c70-3596-4c1f-9688-d1c03967e6c0; detaching it from the instance and deleting it from the info cache
Aug 16 08:12:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-c8d5d0e8-5600-4364-9b30-3061038050d2 req-600a2ab2-9213-453d-ac1d-b04bc9ef3745 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating instance_info_cache with network_info: [{"id": "98aea5dd-a8b3-493c-88b7-39b279a71065", "address": "fa:16:3e:2e:16:79", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98aea5dd-a8", "ovs_interfaceid": "98aea5dd-a8b3-493c-88b7-39b279a71065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "address": "fa:16:3e:c1:b6:6b", "network": {"id": "c2b71937-211f-4709-ab31-4c3b9625dc30", "bridge": "br-int", "label": "tempest-device-tagging-net1-242682653", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c6f6e98-0c", "ovs_interfaceid": "3c6f6e98-0c46-4f70-b579-6dfb0d9fb684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3016cdef-2342-41d7-af0a-feee127affa8", "address": "fa:16:3e:3c:0a:32", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3016cdef-23", "ovs_interfaceid": "3016cdef-2342-41d7-af0a-feee127affa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "address": "fa:16:3e:35:54:2d", "network": {"id": "d1508b84-5f7e-474d-b85a-1488dc467b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-503301241", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4ab62fd66c14cab96934322638feca6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13190e58-60", "ovs_interfaceid": "13190e58-602a-4b42-b35d-c5d977e0cbb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-c8d5d0e8-5600-4364-9b30-3061038050d2 req-600a2ab2-9213-453d-ac1d-b04bc9ef3745 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Detach interface failed, port_id=55f21c70-3596-4c1f-9688-d1c03967e6c0, reason: Instance 5b610a48-4130-48db-91af-0f3926ac775b could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 08:12:45 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:45 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Took 8.80 seconds to deallocate network for instance.
Aug 16 08:12:46 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.759s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG nova.network.neutron [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:12:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:12:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:46 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Took 9.27 seconds to deallocate network for instance.
Aug 16 08:12:46 user nova-compute[73091]: DEBUG nova.policy [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '741b35d305b340bfb00ecffb56a143b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8186c961465c48fc800e3b1ecd4ed077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:12:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Creating image(s)
Aug 16 08:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "/opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "/opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "/opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk 1073741824" returned: 0 in 0.058s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Stashing vm_state: active {{(pid=73091) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.network.neutron [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Successfully created port: fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lazy-loading 'pci_requests' on Instance uuid 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:12:47 user nova-compute[73091]: INFO nova.compute.claims [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Claim successful on node user
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lazy-loading 'resources' on Instance uuid 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lazy-loading 'pci_devices' on Instance uuid 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Cannot resize image /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lazy-loading 'migration_context' on Instance uuid 7aded393-c408-48d9-a30c-78b62ce0d09e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Ensure instance console log exists: /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-019c545e-e7ca-4043-82cd-ffd5b4f350cc req-b3ef31d4-3c17-4c80-b247-6d777cd5fbf1 service nova] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Received event network-vif-deleted-e28992b9-adef-431a-8323-eff7c955648b {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-019c545e-e7ca-4043-82cd-ffd5b4f350cc req-b3ef31d4-3c17-4c80-b247-6d777cd5fbf1 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-deleted-13190e58-602a-4b42-b35d-c5d977e0cbb9 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-019c545e-e7ca-4043-82cd-ffd5b4f350cc req-b3ef31d4-3c17-4c80-b247-6d777cd5fbf1 service nova] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Received event network-vif-deleted-3016cdef-2342-41d7-af0a-feee127affa8 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:47 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating resource usage from migration d7d5c217-793b-440c-a654-b060f016d306
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:12:47 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.701s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:48 user nova-compute[73091]: INFO nova.compute.manager [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Migrating
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Successfully updated port: fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:12:48 user nova-compute[73091]: INFO nova.compute.rpcapi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173553.0398436, bac3dbae-0134-450c-9220-0dd96e74aef0 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:12:48 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] VM Stopped (Lifecycle Event)
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "refresh_cache-7aded393-c408-48d9-a30c-78b62ce0d09e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquired lock "refresh_cache-7aded393-c408-48d9-a30c-78b62ce0d09e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-00179bb2-9e11-4b2f-89a2-d8e6a4a0b179 None None] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquired lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:48 user nova-compute[73091]: INFO nova.compute.manager [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Terminating instance
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 08:12:48 user nova-compute[73091]: INFO nova.compute.manager [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] [instance: bac3dbae-0134-450c-9220-0dd96e74aef0] Took 2.62 seconds to detach 3 volumes for instance.
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-4d090e74-f344-4513-b414-91ba25410539 req-00628844-c917-4fbb-8ed8-f0305553a2f4 service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Received event network-vif-unplugged-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d090e74-f344-4513-b414-91ba25410539 req-00628844-c917-4fbb-8ed8-f0305553a2f4 service nova] Acquiring lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d090e74-f344-4513-b414-91ba25410539 req-00628844-c917-4fbb-8ed8-f0305553a2f4 service nova] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4d090e74-f344-4513-b414-91ba25410539 req-00628844-c917-4fbb-8ed8-f0305553a2f4 service nova] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-4d090e74-f344-4513-b414-91ba25410539 req-00628844-c917-4fbb-8ed8-f0305553a2f4 service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] No waiting events found dispatching network-vif-unplugged-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.compute.manager [req-4d090e74-f344-4513-b414-91ba25410539 req-00628844-c917-4fbb-8ed8-f0305553a2f4 service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Received event network-vif-unplugged-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Updating instance_info_cache with network_info: [{"id": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "address": "fa:16:3e:87:20:9c", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfabf307b-a0", "ovs_interfaceid": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Releasing lock "refresh_cache-7aded393-c408-48d9-a30c-78b62ce0d09e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Instance network_info: |[{"id": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "address": "fa:16:3e:87:20:9c", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfabf307b-a0", "ovs_interfaceid": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Start _get_guest_xml network_info=[{"id": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "address": "fa:16:3e:87:20:9c", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfabf307b-a0", "ovs_interfaceid": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:12:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:12:48 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:12:48 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Deleted allocations for instance bac3dbae-0134-450c-9220-0dd96e74aef0
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1631314331',display_name='tempest-AttachVolumeNegativeTest-server-1631314331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1631314331',id=15,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJT9tEJYWRukuLsIISH9So0PukNxFba+upzbML8U2xsuhxMyzDobw4gu4wcdKc5G/aCAscDHBXWEvSXFR6Ps3p4a3sohKsWzZ8/0Kvc/TR+Tly/3dR95fLMtwRNE0IAP4w==',key_name='tempest-keypair-2134618451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8186c961465c48fc800e3b1ecd4ed077',ramdisk_id='',reservation_id='r-dtvoz8vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1216940805',owner_user_name='tempest-AttachVolumeNegativeTest-1216940805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='741b35d305b340bfb00ecffb56a143b8',uuid=7aded393-c408-48d9-a30c-78b62ce0d09e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "address": "fa:16:3e:87:20:9c", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfabf307b-a0", "ovs_interfaceid": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converting VIF {"id": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "address": "fa:16:3e:87:20:9c", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfabf307b-a0", "ovs_interfaceid": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:20:9c,bridge_name='br-int',has_traffic_filtering=True,id=fabf307b-a015-44fb-a0d5-f44e2d47b2f1,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfabf307b-a0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.objects.instance [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lazy-loading 'pci_devices' on Instance uuid 7aded393-c408-48d9-a30c-78b62ce0d09e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173553.836295, 5b610a48-4130-48db-91af-0f3926ac775b => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:12:48 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] VM Stopped (Lifecycle Event)
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:12:48 user nova-compute[73091]:   <uuid>7aded393-c408-48d9-a30c-78b62ce0d09e</uuid>
Aug 16 08:12:48 user nova-compute[73091]:   <name>instance-0000000f</name>
Aug 16 08:12:48 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:12:48 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:12:48 user nova-compute[73091]:   <metadata>
Aug 16 08:12:48 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:12:48 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:12:48 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1631314331</nova:name>
Aug 16 08:12:48 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:12:48</nova:creationTime>
Aug 16 08:12:48 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:12:48 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:12:48 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:12:48 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:12:48 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:12:48 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:12:48 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:12:48 user nova-compute[73091]:       <nova:owner>
Aug 16 08:12:48 user nova-compute[73091]:         <nova:user uuid="741b35d305b340bfb00ecffb56a143b8">tempest-AttachVolumeNegativeTest-1216940805-project-member</nova:user>
Aug 16 08:12:48 user nova-compute[73091]:         <nova:project uuid="8186c961465c48fc800e3b1ecd4ed077">tempest-AttachVolumeNegativeTest-1216940805</nova:project>
Aug 16 08:12:48 user nova-compute[73091]:       </nova:owner>
Aug 16 08:12:48 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:12:48 user nova-compute[73091]:       <nova:ports>
Aug 16 08:12:48 user nova-compute[73091]:         <nova:port uuid="fabf307b-a015-44fb-a0d5-f44e2d47b2f1">
Aug 16 08:12:48 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 08:12:48 user nova-compute[73091]:         </nova:port>
Aug 16 08:12:48 user nova-compute[73091]:       </nova:ports>
Aug 16 08:12:48 user nova-compute[73091]:     </nova:instance>
Aug 16 08:12:48 user nova-compute[73091]:   </metadata>
Aug 16 08:12:48 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:12:48 user nova-compute[73091]:     <system>
Aug 16 08:12:48 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:12:48 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:12:48 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:12:48 user nova-compute[73091]:       <entry name="serial">7aded393-c408-48d9-a30c-78b62ce0d09e</entry>
Aug 16 08:12:48 user nova-compute[73091]:       <entry name="uuid">7aded393-c408-48d9-a30c-78b62ce0d09e</entry>
Aug 16 08:12:48 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:12:48 user nova-compute[73091]:     </system>
Aug 16 08:12:48 user nova-compute[73091]:   </sysinfo>
Aug 16 08:12:48 user nova-compute[73091]:   <os>
Aug 16 08:12:48 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:12:48 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:12:48 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:12:48 user nova-compute[73091]:   </os>
Aug 16 08:12:48 user nova-compute[73091]:   <features>
Aug 16 08:12:48 user nova-compute[73091]:     <acpi/>
Aug 16 08:12:48 user nova-compute[73091]:     <apic/>
Aug 16 08:12:48 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:12:48 user nova-compute[73091]:   </features>
Aug 16 08:12:48 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:12:48 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:12:48 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:12:48 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:12:48 user nova-compute[73091]:   </clock>
Aug 16 08:12:48 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:12:48 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:12:48 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:12:48 user nova-compute[73091]:   </cpu>
Aug 16 08:12:48 user nova-compute[73091]:   <devices>
Aug 16 08:12:48 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:12:48 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:12:48 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk"/>
Aug 16 08:12:48 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:12:48 user nova-compute[73091]:     </disk>
Aug 16 08:12:48 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:12:48 user nova-compute[73091]:       <mac address="fa:16:3e:87:20:9c"/>
Aug 16 08:12:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:12:48 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:12:48 user nova-compute[73091]:       <target dev="tapfabf307b-a0"/>
Aug 16 08:12:48 user nova-compute[73091]:     </interface>
Aug 16 08:12:48 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:12:48 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/console.log" append="off"/>
Aug 16 08:12:48 user nova-compute[73091]:     </serial>
Aug 16 08:12:48 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:12:48 user nova-compute[73091]:     <video>
Aug 16 08:12:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:12:48 user nova-compute[73091]:     </video>
Aug 16 08:12:48 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:12:48 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:12:48 user nova-compute[73091]:     </rng>
Aug 16 08:12:48 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:12:48 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:12:48 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:12:48 user nova-compute[73091]:     </memballoon>
Aug 16 08:12:48 user nova-compute[73091]:   </devices>
Aug 16 08:12:48 user nova-compute[73091]: </domain>
Aug 16 08:12:48 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1631314331',display_name='tempest-AttachVolumeNegativeTest-server-1631314331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1631314331',id=15,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJT9tEJYWRukuLsIISH9So0PukNxFba+upzbML8U2xsuhxMyzDobw4gu4wcdKc5G/aCAscDHBXWEvSXFR6Ps3p4a3sohKsWzZ8/0Kvc/TR+Tly/3dR95fLMtwRNE0IAP4w==',key_name='tempest-keypair-2134618451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8186c961465c48fc800e3b1ecd4ed077',ramdisk_id='',reservation_id='r-dtvoz8vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1216940805',owner_user_name='tempest-AttachVolumeNegativeTest-1216940805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='741b35d305b340bfb00ecffb56a143b8',uuid=7aded393-c408-48d9-a30c-78b62ce0d09e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "address": "fa:16:3e:87:20:9c", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfabf307b-a0", "ovs_interfaceid": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converting VIF {"id": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "address": "fa:16:3e:87:20:9c", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfabf307b-a0", "ovs_interfaceid": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:20:9c,bridge_name='br-int',has_traffic_filtering=True,id=fabf307b-a015-44fb-a0d5-f44e2d47b2f1,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfabf307b-a0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG os_vif [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:20:9c,bridge_name='br-int',has_traffic_filtering=True,id=fabf307b-a015-44fb-a0d5-f44e2d47b2f1,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfabf307b-a0') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfabf307b-a0, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfabf307b-a0, col_values=(('external_ids', {'iface-id': 'fabf307b-a015-44fb-a0d5-f44e2d47b2f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:20:9c', 'vm-uuid': '7aded393-c408-48d9-a30c-78b62ce0d09e'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ceddc70d-0d90-4bf1-bb60-00f1eecea8d6 None None] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:48 user nova-compute[73091]: INFO os_vif [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:20:9c,bridge_name='br-int',has_traffic_filtering=True,id=fabf307b-a015-44fb-a0d5-f44e2d47b2f1,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfabf307b-a0')
Aug 16 08:12:48 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating instance_info_cache with network_info: [{"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-61d5f5e3-7988-4bdf-ba4a-8a6fd8e33aca tempest-TaggedBootDevicesTest_v242-1352082067 tempest-TaggedBootDevicesTest_v242-1352082067-project-member] Lock "bac3dbae-0134-450c-9220-0dd96e74aef0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.947s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Releasing lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:12:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Instance destroyed successfully.
Aug 16 08:12:49 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lazy-loading 'resources' on Instance uuid a7ae44fc-14fd-457c-8ae7-d8c65df6be2d {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] No VIF found with MAC fa:16:3e:87:20:9c, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2074166526',display_name='tempest-TestVolumeSwap-server-2074166526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2074166526',id=9,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGe9nxmf+SbTX0eV7ugzIHL3tU6jM1S9DqKg36t8XIEp11bOVq8uaW58dsW0L6UI+22Y/adeBacR5UYmuVyn38ZSKbW1ELXAtXdpdFX526PvD/RcuofEOzI333qdh4L7Ag==',key_name='tempest-keypair-1612701411',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:09:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c313d283deb4669823af7dd855c24e0',ramdisk_id='',reservation_id='r-da18dz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1693011815',owner_user_name='tempest-TestVolumeSwap-1693011815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='661df8c68df6455e8144ad8e36725f7c',uuid=a7ae44fc-14fd-457c-8ae7-d8c65df6be2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "address": "fa:16:3e:3d:e4:37", "network": {"id": "20265325-2c56-4e00-9ef1-bf5dccaab55a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-28492343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c313d283deb4669823af7dd855c24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac0de6-d0", "ovs_interfaceid": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Converting VIF {"id": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "address": "fa:16:3e:3d:e4:37", "network": {"id": "20265325-2c56-4e00-9ef1-bf5dccaab55a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-28492343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c313d283deb4669823af7dd855c24e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ac0de6-d0", "ovs_interfaceid": "d8ac0de6-d0c5-4599-88b7-2d6837852ff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:e4:37,bridge_name='br-int',has_traffic_filtering=True,id=d8ac0de6-d0c5-4599-88b7-2d6837852ff3,network=Network(20265325-2c56-4e00-9ef1-bf5dccaab55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ac0de6-d0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG os_vif [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:e4:37,bridge_name='br-int',has_traffic_filtering=True,id=d8ac0de6-d0c5-4599-88b7-2d6837852ff3,network=Network(20265325-2c56-4e00-9ef1-bf5dccaab55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ac0de6-d0') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8ac0de6-d0, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:49 user nova-compute[73091]: INFO os_vif [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:e4:37,bridge_name='br-int',has_traffic_filtering=True,id=d8ac0de6-d0c5-4599-88b7-2d6837852ff3,network=Network(20265325-2c56-4e00-9ef1-bf5dccaab55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ac0de6-d0')
Aug 16 08:12:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Deleting instance files /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d_del
Aug 16 08:12:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Deletion of /opt/stack/data/nova/instances/a7ae44fc-14fd-457c-8ae7-d8c65df6be2d_del complete
Aug 16 08:12:49 user nova-compute[73091]: INFO nova.compute.manager [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] [instance: 5b610a48-4130-48db-91af-0f3926ac775b] Took 2.70 seconds to detach 3 volumes for instance.
Aug 16 08:12:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Starting migrate_disk_and_power_off {{(pid=73091) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:49 user nova-compute[73091]: INFO nova.compute.manager [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 16 08:12:49 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-8c99149e-704a-480a-8e88-9fa993c60001 req-c6ccc12b-486b-46d3-ab53-79fcb6397221 service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Received event network-changed-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-8c99149e-704a-480a-8e88-9fa993c60001 req-c6ccc12b-486b-46d3-ab53-79fcb6397221 service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Refreshing instance network info cache due to event network-changed-fabf307b-a015-44fb-a0d5-f44e2d47b2f1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8c99149e-704a-480a-8e88-9fa993c60001 req-c6ccc12b-486b-46d3-ab53-79fcb6397221 service nova] Acquiring lock "refresh_cache-7aded393-c408-48d9-a30c-78b62ce0d09e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8c99149e-704a-480a-8e88-9fa993c60001 req-c6ccc12b-486b-46d3-ab53-79fcb6397221 service nova] Acquired lock "refresh_cache-7aded393-c408-48d9-a30c-78b62ce0d09e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-8c99149e-704a-480a-8e88-9fa993c60001 req-c6ccc12b-486b-46d3-ab53-79fcb6397221 service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Refreshing network info cache for port fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:12:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:49 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Deleted allocations for instance 5b610a48-4130-48db-91af-0f3926ac775b
Aug 16 08:12:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-02db68d3-e26c-4173-9574-8ace20159cca tempest-TaggedBootDevicesTest-1126604454 tempest-TaggedBootDevicesTest-1126604454-project-member] Lock "5b610a48-4130-48db-91af-0f3926ac775b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.237s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:50 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Instance destroyed successfully.
Aug 16 08:12:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1087600235',display_name='tempest-ServerActionsTestOtherB-server-1087600235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1087600235',id=5,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYOKpfDgZmCpH8NYnZIDX4Q6r6QSrYp8+9Ju9pcp2BTpCW6+zgtRofh+/Nl5vfXB2jjGRnF27mUoD5eGzz9iJpQmGeAh8YbRVeP6cdUfPheYKUhiI9ogz9BCberiIkZFg==',key_name='tempest-keypair-657367706',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec0498ad9dc84c56ad076bae8fd158a8',ramdisk_id='',reservation_id='r-wwzf0so4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1828527690',owner_user_name='tempest-ServerActionsTestOtherB-1828527690-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18882b1744742dbb0b5d157aed696a1',uuid=476de8ea-30dd-4b52-be37-f134e445757f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1821957046-network", "vif_mac": "fa:16:3e:58:35:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converting VIF {"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1821957046-network", "vif_mac": "fa:16:3e:58:35:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_vif [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1acfd5b5-3a, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:50 user nova-compute[73091]: INFO os_vif [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a')
Aug 16 08:12:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQVAUtDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:12:50 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG nova.network.neutron [req-8c99149e-704a-480a-8e88-9fa993c60001 req-c6ccc12b-486b-46d3-ab53-79fcb6397221 service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Updated VIF entry in instance network info cache for port fabf307b-a015-44fb-a0d5-f44e2d47b2f1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG nova.network.neutron [req-8c99149e-704a-480a-8e88-9fa993c60001 req-c6ccc12b-486b-46d3-ab53-79fcb6397221 service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Updating instance_info_cache with network_info: [{"id": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "address": "fa:16:3e:87:20:9c", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfabf307b-a0", "ovs_interfaceid": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8c99149e-704a-480a-8e88-9fa993c60001 req-c6ccc12b-486b-46d3-ab53-79fcb6397221 service nova] Releasing lock "refresh_cache-7aded393-c408-48d9-a30c-78b62ce0d09e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f39409e-54ce-4aae-ae79-c79c5bf19952]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed95fc0-4ca8-4c08-85b2-935c6f8bc2bb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:50 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:50 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:12:50 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:12:50 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:12:50 user nova-compute[73091]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:12:50 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8f05bf9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:12:50 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Took 1.31 seconds to deallocate network for instance.
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[15721483-b990-4e1c-925d-f815b0c82f49]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1008a0d2-9368-4ec0-9dbe-fdb1b929959e]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[899fd71e-1ccb-4831-a467-18c503fb7755]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f47a719-d586-4592-ac8c-74c73094454d]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Received event network-vif-plugged-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] Acquiring lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] No waiting events found dispatching network-vif-plugged-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:50 user nova-compute[73091]: WARNING nova.compute.manager [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Received unexpected event network-vif-plugged-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 for instance with vm_state deleted and task_state None.
Aug 16 08:12:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-vif-unplugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] No waiting events found dispatching network-vif-unplugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:50 user nova-compute[73091]: WARNING nova.compute.manager [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received unexpected event network-vif-unplugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 for instance with vm_state active and task_state resize_migrating.
Aug 16 08:12:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] No waiting events found dispatching network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:50 user nova-compute[73091]: WARNING nova.compute.manager [req-2b175820-bcc0-4a46-a07c-9c36764db905 req-d895d757-c743-4010-be49-94eee25fb62c service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received unexpected event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 for instance with vm_state active and task_state resize_migrating.
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[608da7a0-c096-4595-9f96-67790f888f7f]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8533121a-7cec-46d4-a572-5fea2199669f]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260]
Aug 16 08:12:50 user nova-compute[73091]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260] successful.
Aug 16 08:12:50 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3073abe-4e0f-4efa-a025-f18394d03941]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] <== disconnect_volume: return (359ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:50 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-73a3648e-2bc5-4769-a4e8-4fa649e03c3a req-bb64b65f-2a64-4511-83d1-263333f06116 service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Received event network-vif-plugged-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73a3648e-2bc5-4769-a4e8-4fa649e03c3a req-bb64b65f-2a64-4511-83d1-263333f06116 service nova] Acquiring lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73a3648e-2bc5-4769-a4e8-4fa649e03c3a req-bb64b65f-2a64-4511-83d1-263333f06116 service nova] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73a3648e-2bc5-4769-a4e8-4fa649e03c3a req-bb64b65f-2a64-4511-83d1-263333f06116 service nova] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-73a3648e-2bc5-4769-a4e8-4fa649e03c3a req-bb64b65f-2a64-4511-83d1-263333f06116 service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] No waiting events found dispatching network-vif-plugged-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:51 user nova-compute[73091]: WARNING nova.compute.manager [req-73a3648e-2bc5-4769-a4e8-4fa649e03c3a req-bb64b65f-2a64-4511-83d1-263333f06116 service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Received unexpected event network-vif-plugged-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 for instance with vm_state building and task_state spawning.
Aug 16 08:12:51 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f_resize/disk /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.743s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:51 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Deleted allocations for instance a7ae44fc-14fd-457c-8ae7-d8c65df6be2d
Aug 16 08:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0af17517-f8b3-45a1-9a5b-b1e8263768e9 tempest-TestVolumeSwap-1693011815 tempest-TestVolumeSwap-1693011815-project-member] Lock "a7ae44fc-14fd-457c-8ae7-d8c65df6be2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.222s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CMD "cp -r /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f_resize/disk /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk" returned: 0 in 0.374s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f_resize/disk.info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk.info {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CMD "cp -r /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f_resize/disk.info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk.info" returned: 0 in 0.036s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-8695ea7f-3d4f-4de5-b19f-3b19ab9f5d1f req-ed7270d2-7e92-485d-87f0-91bb46dcf336 service nova] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Received event network-vif-deleted-d8ac0de6-d0c5-4599-88b7-2d6837852ff3 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Port 1acfd5b5-3ae9-44d0-822d-7382be3fd551 binding to destination host user is already ACTIVE {{(pid=73091) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 08:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:12:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquired lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:12:52 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173573.008308, 7aded393-c408-48d9-a30c-78b62ce0d09e => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:12:53 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] VM Resumed (Lifecycle Event)
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:12:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Instance spawned successfully.
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:12:53 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173573.0095396, 7aded393-c408-48d9-a30c-78b62ce0d09e => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:12:53 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] VM Started (Lifecycle Event)
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:12:53 user nova-compute[73091]: INFO nova.compute.manager [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Took 6.62 seconds to spawn the instance on the hypervisor.
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:12:53 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-3ec4c44b-b351-484e-a23b-2820700316ad req-452542ba-69e7-4996-bfaf-49ac41bdfb3a service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Received event network-vif-plugged-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ec4c44b-b351-484e-a23b-2820700316ad req-452542ba-69e7-4996-bfaf-49ac41bdfb3a service nova] Acquiring lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ec4c44b-b351-484e-a23b-2820700316ad req-452542ba-69e7-4996-bfaf-49ac41bdfb3a service nova] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3ec4c44b-b351-484e-a23b-2820700316ad req-452542ba-69e7-4996-bfaf-49ac41bdfb3a service nova] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.compute.manager [req-3ec4c44b-b351-484e-a23b-2820700316ad req-452542ba-69e7-4996-bfaf-49ac41bdfb3a service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] No waiting events found dispatching network-vif-plugged-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:12:53 user nova-compute[73091]: WARNING nova.compute.manager [req-3ec4c44b-b351-484e-a23b-2820700316ad req-452542ba-69e7-4996-bfaf-49ac41bdfb3a service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Received unexpected event network-vif-plugged-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 for instance with vm_state building and task_state spawning.
Aug 16 08:12:53 user nova-compute[73091]: INFO nova.compute.manager [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Took 7.78 seconds to build instance.
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-122f5181-4041-44b3-a712-81511dba3a88 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.885s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating instance_info_cache with network_info: [{"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Releasing lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG os_brick.utils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe77c92-834c-4994-a5d9-386720155668]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f23b185-4fc1-4a98-aada-6f5c4127a3c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baa955e-a6fc-4ec6-8307-3339607ecee4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a8a845-e518-40c4-9d3b-f511a6a0f302]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:12:53 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:12:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac06995-9130-4b6a-b21b-d7bf59db3973]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:12:53 user nova-compute[73091]: DEBUG os_brick.utils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:12:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:12:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Starting finish_migration {{(pid=73091) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 08:13:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 08:13:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Creating image(s)
Aug 16 08:13:03 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lazy-loading 'trusted_certs' on Instance uuid 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Checking if we can resize image /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk. size=21474836480 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173569.0201206, a7ae44fc-14fd-457c-8ae7-d8c65df6be2d => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:13:04 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] VM Stopped (Lifecycle Event)
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0d278f18-4d82-4781-b9be-4fcdb65852c5 None None] [instance: a7ae44fc-14fd-457c-8ae7-d8c65df6be2d] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk 21474836480 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk 21474836480" returned: 0 in 0.058s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Ensure instance console log exists: /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Start _get_guest_xml network_info=[{"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1821957046-network", "vif_mac": "fa:16:3e:58:35:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'attachment_id': 'f5475ea0-d61c-4bd8-9420-023ca5d73ae2', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQVAUtDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '476de8ea-30dd-4b52-be37-f134e445757f', 'attached_at': '2023-08-16T08:13:04.000000', 'detached_at': '', 'volume_id': '0f37e5a8-0be3-43d7-bff6-390364c5e37c', 'serial': '0f37e5a8-0be3-43d7-bff6-390364c5e37c'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:13:04 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:13:04 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lazy-loading 'vcpu_model' on Instance uuid 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQVAUtDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:13:04 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:13:04 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:13:04 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fa226e-9b39-4389-b4c8-9b01aceac7dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:13:04 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[780b2f35-3c0f-4604-b9af-6231b66d15ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c] added
Aug 16 08:13:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3df6352-66d5-44c7-a76c-7c7a31c69f65]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd098488-8963-4198-ba22-fcbc0136b380]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQVAUtDu {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQVAUtDu" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dbcf00-0901-4e54-93e9-705ae1720c0b]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FQVAUtDu'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc001342-2df2-476c-a356-81c0560e3c6a]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76f30b8-47bf-47b9-adaa-92ebe3d6610d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:13:04 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:13:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:13:04 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:13:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9cc32a-96a7-4b0c-9bdc-aa2098e0f2c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260]
Aug 16 08:13:04 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260] successful.
Aug 16 08:13:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e10bfa-452f-440f-b02a-f60551412555]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fba18f-9bc5-4b9d-978a-e6d2f9c82ed7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:13:04 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:13:04 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:13:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:13:04 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:13:04 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:13:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.035s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e424e2ca-3462-4528-9ee9-26b37225dc66]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:13:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQVAUtDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173570.3533802, 476de8ea-30dd-4b52-be37-f134e445757f => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:13:05 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] VM Stopped (Lifecycle Event)
Aug 16 08:13:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8d0b897c-0fbc-46d2-8b4e-3e0763912af9 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8d0b897c-0fbc-46d2-8b4e-3e0763912af9 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:13:05 user nova-compute[73091]: INFO nova.compute.manager [None req-8d0b897c-0fbc-46d2-8b4e-3e0763912af9 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 08:13:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26435303336653430', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435303336653430', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1087600235',display_name='tempest-ServerActionsTestOtherB-server-1087600235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1087600235',id=5,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYOKpfDgZmCpH8NYnZIDX4Q6r6QSrYp8+9Ju9pcp2BTpCW6+zgtRofh+/Nl5vfXB2jjGRnF27mUoD5eGzz9iJpQmGeAh8YbRVeP6cdUfPheYKUhiI9ogz9BCberiIkZFg==',key_name='tempest-keypair-657367706',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec0498ad9dc84c56ad076bae8fd158a8',ramdisk_id='',reservation_id='r-wwzf0so4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1828527690',owner_user_name='tempest-ServerActionsTestOtherB-1828527690-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18882b1744742dbb0b5d157aed696a1',uuid=476de8ea-30dd-4b52-be37-f134e445757f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1821957046-network", "vif_mac": "fa:16:3e:58:35:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converting VIF {"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1821957046-network", "vif_mac": "fa:16:3e:58:35:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:13:05 user nova-compute[73091]:   <uuid>476de8ea-30dd-4b52-be37-f134e445757f</uuid>
Aug 16 08:13:05 user nova-compute[73091]:   <name>instance-00000005</name>
Aug 16 08:13:05 user nova-compute[73091]:   <memory>2097152</memory>
Aug 16 08:13:05 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:13:05 user nova-compute[73091]:   <metadata>
Aug 16 08:13:05 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:13:05 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:13:05 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherB-server-1087600235</nova:name>
Aug 16 08:13:05 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:13:04</nova:creationTime>
Aug 16 08:13:05 user nova-compute[73091]:       <nova:flavor name="m1.small">
Aug 16 08:13:05 user nova-compute[73091]:         <nova:memory>2048</nova:memory>
Aug 16 08:13:05 user nova-compute[73091]:         <nova:disk>20</nova:disk>
Aug 16 08:13:05 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:13:05 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:13:05 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:13:05 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:13:05 user nova-compute[73091]:       <nova:owner>
Aug 16 08:13:05 user nova-compute[73091]:         <nova:user uuid="c18882b1744742dbb0b5d157aed696a1">tempest-ServerActionsTestOtherB-1828527690-project-member</nova:user>
Aug 16 08:13:05 user nova-compute[73091]:         <nova:project uuid="ec0498ad9dc84c56ad076bae8fd158a8">tempest-ServerActionsTestOtherB-1828527690</nova:project>
Aug 16 08:13:05 user nova-compute[73091]:       </nova:owner>
Aug 16 08:13:05 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:13:05 user nova-compute[73091]:       <nova:ports>
Aug 16 08:13:05 user nova-compute[73091]:         <nova:port uuid="1acfd5b5-3ae9-44d0-822d-7382be3fd551">
Aug 16 08:13:05 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 08:13:05 user nova-compute[73091]:         </nova:port>
Aug 16 08:13:05 user nova-compute[73091]:       </nova:ports>
Aug 16 08:13:05 user nova-compute[73091]:     </nova:instance>
Aug 16 08:13:05 user nova-compute[73091]:   </metadata>
Aug 16 08:13:05 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:13:05 user nova-compute[73091]:     <system>
Aug 16 08:13:05 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:13:05 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:13:05 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:13:05 user nova-compute[73091]:       <entry name="serial">476de8ea-30dd-4b52-be37-f134e445757f</entry>
Aug 16 08:13:05 user nova-compute[73091]:       <entry name="uuid">476de8ea-30dd-4b52-be37-f134e445757f</entry>
Aug 16 08:13:05 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:13:05 user nova-compute[73091]:     </system>
Aug 16 08:13:05 user nova-compute[73091]:   </sysinfo>
Aug 16 08:13:05 user nova-compute[73091]:   <os>
Aug 16 08:13:05 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:13:05 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:13:05 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:13:05 user nova-compute[73091]:   </os>
Aug 16 08:13:05 user nova-compute[73091]:   <features>
Aug 16 08:13:05 user nova-compute[73091]:     <acpi/>
Aug 16 08:13:05 user nova-compute[73091]:     <apic/>
Aug 16 08:13:05 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:13:05 user nova-compute[73091]:   </features>
Aug 16 08:13:05 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:13:05 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:13:05 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:13:05 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:13:05 user nova-compute[73091]:   </clock>
Aug 16 08:13:05 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:13:05 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:13:05 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:13:05 user nova-compute[73091]:   </cpu>
Aug 16 08:13:05 user nova-compute[73091]:   <devices>
Aug 16 08:13:05 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:13:05 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:13:05 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk"/>
Aug 16 08:13:05 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:13:05 user nova-compute[73091]:     </disk>
Aug 16 08:13:05 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:13:05 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:13:05 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 16 08:13:05 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 08:13:05 user nova-compute[73091]:       <serial>0f37e5a8-0be3-43d7-bff6-390364c5e37c</serial>
Aug 16 08:13:05 user nova-compute[73091]:     </disk>
Aug 16 08:13:05 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:13:05 user nova-compute[73091]:       <mac address="fa:16:3e:58:35:e3"/>
Aug 16 08:13:05 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:13:05 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:13:05 user nova-compute[73091]:       <target dev="tap1acfd5b5-3a"/>
Aug 16 08:13:05 user nova-compute[73091]:     </interface>
Aug 16 08:13:05 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:13:05 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/console.log" append="off"/>
Aug 16 08:13:05 user nova-compute[73091]:     </serial>
Aug 16 08:13:05 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:13:05 user nova-compute[73091]:     <video>
Aug 16 08:13:05 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:13:05 user nova-compute[73091]:     </video>
Aug 16 08:13:05 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:13:05 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:13:05 user nova-compute[73091]:     </rng>
Aug 16 08:13:05 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:13:05 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:13:05 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:13:05 user nova-compute[73091]:     </memballoon>
Aug 16 08:13:05 user nova-compute[73091]:   </devices>
Aug 16 08:13:05 user nova-compute[73091]: </domain>
Aug 16 08:13:05 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1087600235',display_name='tempest-ServerActionsTestOtherB-server-1087600235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1087600235',id=5,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYOKpfDgZmCpH8NYnZIDX4Q6r6QSrYp8+9Ju9pcp2BTpCW6+zgtRofh+/Nl5vfXB2jjGRnF27mUoD5eGzz9iJpQmGeAh8YbRVeP6cdUfPheYKUhiI9ogz9BCberiIkZFg==',key_name='tempest-keypair-657367706',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec0498ad9dc84c56ad076bae8fd158a8',ramdisk_id='',reservation_id='r-wwzf0so4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1828527690',owner_user_name='tempest-ServerActionsTestOtherB-1828527690-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18882b1744742dbb0b5d157aed696a1',uuid=476de8ea-30dd-4b52-be37-f134e445757f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1821957046-network", "vif_mac": "fa:16:3e:58:35:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converting VIF {"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1821957046-network", "vif_mac": "fa:16:3e:58:35:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG os_vif [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1acfd5b5-3a, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1acfd5b5-3a, col_values=(('external_ids', {'iface-id': '1acfd5b5-3ae9-44d0-822d-7382be3fd551', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:35:e3', 'vm-uuid': '476de8ea-30dd-4b52-be37-f134e445757f'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:05 user nova-compute[73091]: INFO os_vif [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a')
Aug 16 08:13:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:13:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] No VIF found with MAC fa:16:3e:58:35:e3, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:13:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-20a8eb9f-5b13-4ea1-b386-c1cf5d34476d req-6552f416-c075-45d8-a24a-f16a6c5a6b9d service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-20a8eb9f-5b13-4ea1-b386-c1cf5d34476d req-6552f416-c075-45d8-a24a-f16a6c5a6b9d service nova] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-20a8eb9f-5b13-4ea1-b386-c1cf5d34476d req-6552f416-c075-45d8-a24a-f16a6c5a6b9d service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-20a8eb9f-5b13-4ea1-b386-c1cf5d34476d req-6552f416-c075-45d8-a24a-f16a6c5a6b9d service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-20a8eb9f-5b13-4ea1-b386-c1cf5d34476d req-6552f416-c075-45d8-a24a-f16a6c5a6b9d service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] No waiting events found dispatching network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:13:07 user nova-compute[73091]: WARNING nova.compute.manager [req-20a8eb9f-5b13-4ea1-b386-c1cf5d34476d req-6552f416-c075-45d8-a24a-f16a6c5a6b9d service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received unexpected event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 for instance with vm_state active and task_state resize_finish.
Aug 16 08:13:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:09 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173589.3326645, 476de8ea-30dd-4b52-be37-f134e445757f => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:13:09 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] VM Resumed (Lifecycle Event)
Aug 16 08:13:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:13:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Instance running successfully.
Aug 16 08:13:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Failed to set time: agent not configured {{(pid=73091) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 08:13:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-c188c104-c1b7-4abf-8f78-df8e4c6937b0 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] finish_migration finished successfully. {{(pid=73091) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 08:13:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:13:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:13:09 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 08:13:09 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173589.334282, 476de8ea-30dd-4b52-be37-f134e445757f => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:13:09 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] VM Started (Lifecycle Event)
Aug 16 08:13:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:13:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:13:09 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 08:13:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-8b64ade4-9451-4f5d-8745-7d523518465d req-97a8c1b4-1cd6-4a9b-8b7b-6d452ada8471 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8b64ade4-9451-4f5d-8745-7d523518465d req-97a8c1b4-1cd6-4a9b-8b7b-6d452ada8471 service nova] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8b64ade4-9451-4f5d-8745-7d523518465d req-97a8c1b4-1cd6-4a9b-8b7b-6d452ada8471 service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8b64ade4-9451-4f5d-8745-7d523518465d req-97a8c1b4-1cd6-4a9b-8b7b-6d452ada8471 service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-8b64ade4-9451-4f5d-8745-7d523518465d req-97a8c1b4-1cd6-4a9b-8b7b-6d452ada8471 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] No waiting events found dispatching network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:13:09 user nova-compute[73091]: WARNING nova.compute.manager [req-8b64ade4-9451-4f5d-8745-7d523518465d req-97a8c1b4-1cd6-4a9b-8b7b-6d452ada8471 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received unexpected event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 for instance with vm_state resized and task_state None.
Aug 16 08:13:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:12 user nova-compute[73091]: INFO nova.compute.manager [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Rescuing
Aug 16 08:13:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:13:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquired lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:13:12 user nova-compute[73091]: DEBUG nova.network.neutron [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:13:13 user nova-compute[73091]: DEBUG nova.network.neutron [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Updating instance_info_cache with network_info: [{"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:13:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Releasing lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:13:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-91067047-3b0d-41c1-98f2-934960df4a65 req-00c37d85-182a-4f8e-b737-6ed31ed36f37 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received event network-vif-unplugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-91067047-3b0d-41c1-98f2-934960df4a65 req-00c37d85-182a-4f8e-b737-6ed31ed36f37 service nova] Acquiring lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-91067047-3b0d-41c1-98f2-934960df4a65 req-00c37d85-182a-4f8e-b737-6ed31ed36f37 service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-91067047-3b0d-41c1-98f2-934960df4a65 req-00c37d85-182a-4f8e-b737-6ed31ed36f37 service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:13 user nova-compute[73091]: DEBUG nova.compute.manager [req-91067047-3b0d-41c1-98f2-934960df4a65 req-00c37d85-182a-4f8e-b737-6ed31ed36f37 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] No waiting events found dispatching network-vif-unplugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:13:13 user nova-compute[73091]: WARNING nova.compute.manager [req-91067047-3b0d-41c1-98f2-934960df4a65 req-00c37d85-182a-4f8e-b737-6ed31ed36f37 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received unexpected event network-vif-unplugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 for instance with vm_state active and task_state rescuing.
Aug 16 08:13:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Instance destroyed successfully.
Aug 16 08:13:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Attempting rescue
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 08:13:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Creating image(s)
Aug 16 08:13:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "/opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "/opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'trusted_certs' on Instance uuid bd541280-cecf-4c1c-bd1f-f7edff830f1e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.241s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.rescue {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.rescue" returned: 0 in 0.073s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'migration_context' on Instance uuid bd541280-cecf-4c1c-bd1f-f7edff830f1e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Start _get_guest_xml network_info=[{"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "vif_mac": "fa:16:3e:60:a4:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'resources' on Instance uuid bd541280-cecf-4c1c-bd1f-f7edff830f1e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'numa_topology' on Instance uuid bd541280-cecf-4c1c-bd1f-f7edff830f1e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:14 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:13:14 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'vcpu_model' on Instance uuid bd541280-cecf-4c1c-bd1f-f7edff830f1e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1967828394',display_name='tempest-ServerRescueNegativeTestJSON-server-1967828394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1967828394',id=1,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:08:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='417ed7a5d52f4f7eaa4b6328864808ea',ramdisk_id='',reservation_id='r-vqktvm90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1374385894',owner_user_name='tempest-ServerRescueNegativeTestJSON-1374385894-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:08:47Z,user_data=None,user_id='7a24330919014a2985e7926747cbbcdc',uuid=bd541280-cecf-4c1c-bd1f-f7edff830f1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "vif_mac": "fa:16:3e:60:a4:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converting VIF {"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "vif_mac": "fa:16:3e:60:a4:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=92dd6fb6-f2a1-4af9-be67-6fd7770517e4,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92dd6fb6-f2') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.objects.instance [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'pci_devices' on Instance uuid bd541280-cecf-4c1c-bd1f-f7edff830f1e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:13:14 user nova-compute[73091]:   <uuid>bd541280-cecf-4c1c-bd1f-f7edff830f1e</uuid>
Aug 16 08:13:14 user nova-compute[73091]:   <name>instance-00000001</name>
Aug 16 08:13:14 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:13:14 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:13:14 user nova-compute[73091]:   <metadata>
Aug 16 08:13:14 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:13:14 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:13:14 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1967828394</nova:name>
Aug 16 08:13:14 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:13:14</nova:creationTime>
Aug 16 08:13:14 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:13:14 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:13:14 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:13:14 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:13:14 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:13:14 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:13:14 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:13:14 user nova-compute[73091]:       <nova:owner>
Aug 16 08:13:14 user nova-compute[73091]:         <nova:user uuid="7a24330919014a2985e7926747cbbcdc">tempest-ServerRescueNegativeTestJSON-1374385894-project-member</nova:user>
Aug 16 08:13:14 user nova-compute[73091]:         <nova:project uuid="417ed7a5d52f4f7eaa4b6328864808ea">tempest-ServerRescueNegativeTestJSON-1374385894</nova:project>
Aug 16 08:13:14 user nova-compute[73091]:       </nova:owner>
Aug 16 08:13:14 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:13:14 user nova-compute[73091]:       <nova:ports>
Aug 16 08:13:14 user nova-compute[73091]:         <nova:port uuid="92dd6fb6-f2a1-4af9-be67-6fd7770517e4">
Aug 16 08:13:14 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 08:13:14 user nova-compute[73091]:         </nova:port>
Aug 16 08:13:14 user nova-compute[73091]:       </nova:ports>
Aug 16 08:13:14 user nova-compute[73091]:     </nova:instance>
Aug 16 08:13:14 user nova-compute[73091]:   </metadata>
Aug 16 08:13:14 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:13:14 user nova-compute[73091]:     <system>
Aug 16 08:13:14 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:13:14 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:13:14 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:13:14 user nova-compute[73091]:       <entry name="serial">bd541280-cecf-4c1c-bd1f-f7edff830f1e</entry>
Aug 16 08:13:14 user nova-compute[73091]:       <entry name="uuid">bd541280-cecf-4c1c-bd1f-f7edff830f1e</entry>
Aug 16 08:13:14 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:13:14 user nova-compute[73091]:     </system>
Aug 16 08:13:14 user nova-compute[73091]:   </sysinfo>
Aug 16 08:13:14 user nova-compute[73091]:   <os>
Aug 16 08:13:14 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:13:14 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:13:14 user nova-compute[73091]:   </os>
Aug 16 08:13:14 user nova-compute[73091]:   <features>
Aug 16 08:13:14 user nova-compute[73091]:     <acpi/>
Aug 16 08:13:14 user nova-compute[73091]:     <apic/>
Aug 16 08:13:14 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:13:14 user nova-compute[73091]:   </features>
Aug 16 08:13:14 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:13:14 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:13:14 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:13:14 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:13:14 user nova-compute[73091]:   </clock>
Aug 16 08:13:14 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:13:14 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:13:14 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:13:14 user nova-compute[73091]:   </cpu>
Aug 16 08:13:14 user nova-compute[73091]:   <devices>
Aug 16 08:13:14 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:13:14 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:13:14 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.rescue"/>
Aug 16 08:13:14 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:13:14 user nova-compute[73091]:     </disk>
Aug 16 08:13:14 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:13:14 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:13:14 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk"/>
Aug 16 08:13:14 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 08:13:14 user nova-compute[73091]:     </disk>
Aug 16 08:13:14 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:13:14 user nova-compute[73091]:       <mac address="fa:16:3e:60:a4:3f"/>
Aug 16 08:13:14 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:13:14 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:13:14 user nova-compute[73091]:       <target dev="tap92dd6fb6-f2"/>
Aug 16 08:13:14 user nova-compute[73091]:     </interface>
Aug 16 08:13:14 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:13:14 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/console.log" append="off"/>
Aug 16 08:13:14 user nova-compute[73091]:     </serial>
Aug 16 08:13:14 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:13:14 user nova-compute[73091]:     <video>
Aug 16 08:13:14 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:13:14 user nova-compute[73091]:     </video>
Aug 16 08:13:14 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:13:14 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:13:14 user nova-compute[73091]:     </rng>
Aug 16 08:13:14 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:13:14 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:13:14 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:13:14 user nova-compute[73091]:     </memballoon>
Aug 16 08:13:14 user nova-compute[73091]:   </devices>
Aug 16 08:13:14 user nova-compute[73091]: </domain>
Aug 16 08:13:14 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:13:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Instance destroyed successfully.
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:13:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No VIF found with MAC fa:16:3e:60:a4:3f, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:13:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-5ddc83a4-ab68-448f-91a6-1e67f4ad27f1 req-1f30f4f1-a621-42d4-aff3-ddd8000a1d6a service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ddc83a4-ab68-448f-91a6-1e67f4ad27f1 req-1f30f4f1-a621-42d4-aff3-ddd8000a1d6a service nova] Acquiring lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ddc83a4-ab68-448f-91a6-1e67f4ad27f1 req-1f30f4f1-a621-42d4-aff3-ddd8000a1d6a service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5ddc83a4-ab68-448f-91a6-1e67f4ad27f1 req-1f30f4f1-a621-42d4-aff3-ddd8000a1d6a service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-5ddc83a4-ab68-448f-91a6-1e67f4ad27f1 req-1f30f4f1-a621-42d4-aff3-ddd8000a1d6a service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] No waiting events found dispatching network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:13:16 user nova-compute[73091]: WARNING nova.compute.manager [req-5ddc83a4-ab68-448f-91a6-1e67f4ad27f1 req-1f30f4f1-a621-42d4-aff3-ddd8000a1d6a service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received unexpected event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 for instance with vm_state active and task_state rescuing.
Aug 16 08:13:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-f2c293f7-1724-4036-91a9-02c9eef6f9aa req-b48f3dc5-6def-44af-b056-b3015b64e018 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f2c293f7-1724-4036-91a9-02c9eef6f9aa req-b48f3dc5-6def-44af-b056-b3015b64e018 service nova] Acquiring lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f2c293f7-1724-4036-91a9-02c9eef6f9aa req-b48f3dc5-6def-44af-b056-b3015b64e018 service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f2c293f7-1724-4036-91a9-02c9eef6f9aa req-b48f3dc5-6def-44af-b056-b3015b64e018 service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-f2c293f7-1724-4036-91a9-02c9eef6f9aa req-b48f3dc5-6def-44af-b056-b3015b64e018 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] No waiting events found dispatching network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:13:18 user nova-compute[73091]: WARNING nova.compute.manager [req-f2c293f7-1724-4036-91a9-02c9eef6f9aa req-b48f3dc5-6def-44af-b056-b3015b64e018 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received unexpected event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 for instance with vm_state active and task_state rescuing.
Aug 16 08:13:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-f2c293f7-1724-4036-91a9-02c9eef6f9aa req-b48f3dc5-6def-44af-b056-b3015b64e018 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f2c293f7-1724-4036-91a9-02c9eef6f9aa req-b48f3dc5-6def-44af-b056-b3015b64e018 service nova] Acquiring lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f2c293f7-1724-4036-91a9-02c9eef6f9aa req-b48f3dc5-6def-44af-b056-b3015b64e018 service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f2c293f7-1724-4036-91a9-02c9eef6f9aa req-b48f3dc5-6def-44af-b056-b3015b64e018 service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-f2c293f7-1724-4036-91a9-02c9eef6f9aa req-b48f3dc5-6def-44af-b056-b3015b64e018 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] No waiting events found dispatching network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:13:18 user nova-compute[73091]: WARNING nova.compute.manager [req-f2c293f7-1724-4036-91a9-02c9eef6f9aa req-b48f3dc5-6def-44af-b056-b3015b64e018 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received unexpected event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 for instance with vm_state active and task_state rescuing.
Aug 16 08:13:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Removed pending event for bd541280-cecf-4c1c-bd1f-f7edff830f1e due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 08:13:18 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173598.6203475, bd541280-cecf-4c1c-bd1f-f7edff830f1e => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:13:18 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] VM Resumed (Lifecycle Event)
Aug 16 08:13:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-78fc9d2c-bd2b-4d1b-b3fb-7a4611b0ae59 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:13:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:13:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:13:18 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 08:13:18 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173598.6209834, bd541280-cecf-4c1c-bd1f-f7edff830f1e => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:13:18 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] VM Started (Lifecycle Event)
Aug 16 08:13:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:13:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:13:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:19 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:13:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:19 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:13:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:13:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:23 user nova-compute[73091]: INFO nova.compute.manager [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Rescuing
Aug 16 08:13:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:13:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquired lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:13:23 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:13:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:13:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:13:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:13:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=7389MB free_disk=25.52981948852539GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Applying migration context for instance 476de8ea-30dd-4b52-be37-f134e445757f as it has an incoming, in-progress migration d7d5c217-793b-440c-a654-b060f016d306. Migration status is finished {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 08:13:24 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating resource usage from migration d7d5c217-793b-440c-a654-b060f016d306
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance bd541280-cecf-4c1c-bd1f-f7edff830f1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4a6248b9-f577-4efd-baa2-eb5eb3e47495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance cc7973d9-c703-4345-bf58-ccbe80fd07ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance daf2b789-eba2-419b-99f6-be8f483151ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 6060dcaf-e451-4308-b96f-43bcbf56d621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 58fb6a40-f818-4515-be92-9f5dd96e40d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4f76c866-84a8-499c-a96c-21a2d65ca3d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 18850651-02ac-459a-838c-b3216bcbe131 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 7aded393-c408-48d9-a30c-78b62ce0d09e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Migration d7d5c217-793b-440c-a654-b060f016d306 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 476de8ea-30dd-4b52-be37-f134e445757f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:13:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Updating instance_info_cache with network_info: [{"id": "df5af82e-6121-4551-aea4-adf6897bc4e1", "address": "fa:16:3e:49:79:1a", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5af82e-61", "ovs_interfaceid": "df5af82e-6121-4551-aea4-adf6897bc4e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Releasing lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-6d245ed4-3cd9-400b-9b91-9ff43cf6f51a req-4bf89462-f074-4e11-98be-f37760e9a9a0 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received event network-vif-unplugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6d245ed4-3cd9-400b-9b91-9ff43cf6f51a req-4bf89462-f074-4e11-98be-f37760e9a9a0 service nova] Acquiring lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6d245ed4-3cd9-400b-9b91-9ff43cf6f51a req-4bf89462-f074-4e11-98be-f37760e9a9a0 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6d245ed4-3cd9-400b-9b91-9ff43cf6f51a req-4bf89462-f074-4e11-98be-f37760e9a9a0 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:25 user nova-compute[73091]: DEBUG nova.compute.manager [req-6d245ed4-3cd9-400b-9b91-9ff43cf6f51a req-4bf89462-f074-4e11-98be-f37760e9a9a0 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] No waiting events found dispatching network-vif-unplugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:13:25 user nova-compute[73091]: WARNING nova.compute.manager [req-6d245ed4-3cd9-400b-9b91-9ff43cf6f51a req-4bf89462-f074-4e11-98be-f37760e9a9a0 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received unexpected event network-vif-unplugged-df5af82e-6121-4551-aea4-adf6897bc4e1 for instance with vm_state active and task_state rescuing.
Aug 16 08:13:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Instance destroyed successfully.
Aug 16 08:13:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Attempting a stable device rescue
Aug 16 08:13:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 08:13:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 08:13:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Creating image(s)
Aug 16 08:13:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f76c866-84a8-499c-a96c-21a2d65ca3d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "/opt/stack/data/nova/instances/4f76c866-84a8-499c-a96c-21a2d65ca3d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "/opt/stack/data/nova/instances/4f76c866-84a8-499c-a96c-21a2d65ca3d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:26 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4f76c866-84a8-499c-a96c-21a2d65ca3d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "9dd661ae0b4d1e65b604f5956aa60287eb840bcb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "9dd661ae0b4d1e65b604f5956aa60287eb840bcb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9dd661ae0b4d1e65b604f5956aa60287eb840bcb.part --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9dd661ae0b4d1e65b604f5956aa60287eb840bcb.part --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:27 user nova-compute[73091]: DEBUG nova.virt.images [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] bbbf2e31-5625-4985-80a3-e5ea9d9eb8ca was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 08:13:27 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 08:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9dd661ae0b4d1e65b604f5956aa60287eb840bcb.part /opt/stack/data/nova/instances/_base/9dd661ae0b4d1e65b604f5956aa60287eb840bcb.converted {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9dd661ae0b4d1e65b604f5956aa60287eb840bcb.part /opt/stack/data/nova/instances/_base/9dd661ae0b4d1e65b604f5956aa60287eb840bcb.converted" returned: 0 in 0.313s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9dd661ae0b4d1e65b604f5956aa60287eb840bcb.converted --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-a8341885-24f9-4869-8721-4f10785f2ed1 req-98563cdd-d42e-4691-b9cc-cd6b252b606a service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8341885-24f9-4869-8721-4f10785f2ed1 req-98563cdd-d42e-4691-b9cc-cd6b252b606a service nova] Acquiring lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8341885-24f9-4869-8721-4f10785f2ed1 req-98563cdd-d42e-4691-b9cc-cd6b252b606a service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8341885-24f9-4869-8721-4f10785f2ed1 req-98563cdd-d42e-4691-b9cc-cd6b252b606a service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-a8341885-24f9-4869-8721-4f10785f2ed1 req-98563cdd-d42e-4691-b9cc-cd6b252b606a service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] No waiting events found dispatching network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:13:27 user nova-compute[73091]: WARNING nova.compute.manager [req-a8341885-24f9-4869-8721-4f10785f2ed1 req-98563cdd-d42e-4691-b9cc-cd6b252b606a service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received unexpected event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 for instance with vm_state active and task_state rescuing.
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9dd661ae0b4d1e65b604f5956aa60287eb840bcb.converted --force-share --output=json" returned: 0 in 0.226s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "9dd661ae0b4d1e65b604f5956aa60287eb840bcb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.777s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "9dd661ae0b4d1e65b604f5956aa60287eb840bcb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "9dd661ae0b4d1e65b604f5956aa60287eb840bcb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9dd661ae0b4d1e65b604f5956aa60287eb840bcb --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9dd661ae0b4d1e65b604f5956aa60287eb840bcb --force-share --output=json" returned: 0 in 0.233s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9dd661ae0b4d1e65b604f5956aa60287eb840bcb,backing_fmt=raw /opt/stack/data/nova/instances/4f76c866-84a8-499c-a96c-21a2d65ca3d4/disk.rescue {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquired lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9dd661ae0b4d1e65b604f5956aa60287eb840bcb,backing_fmt=raw /opt/stack/data/nova/instances/4f76c866-84a8-499c-a96c-21a2d65ca3d4/disk.rescue" returned: 0 in 0.054s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "9dd661ae0b4d1e65b604f5956aa60287eb840bcb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lazy-loading 'migration_context' on Instance uuid 4f76c866-84a8-499c-a96c-21a2d65ca3d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Start _get_guest_xml network_info=[{"id": "df5af82e-6121-4551-aea4-adf6897bc4e1", "address": "fa:16:3e:49:79:1a", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "vif_mac": "fa:16:3e:49:79:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5af82e-61", "ovs_interfaceid": "df5af82e-6121-4551-aea4-adf6897bc4e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bbbf2e31-5625-4985-80a3-e5ea9d9eb8ca', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': 'f5ee062b-8f05-4e09-9b3a-46dbd9751bcb', 'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hxRqMVLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '4f76c866-84a8-499c-a96c-21a2d65ca3d4', 'attached_at': '', 'detached_at': '', 'volume_id': '5b085feb-a997-40d9-a120-66c7a45b64f5', 'serial': '5b085feb-a997-40d9-a120-66c7a45b64f5'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lazy-loading 'resources' on Instance uuid 4f76c866-84a8-499c-a96c-21a2d65ca3d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f76c866-84a8-499c-a96c-21a2d65ca3d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:28 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:13:28 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f76c866-84a8-499c-a96c-21a2d65ca3d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hxRqMVLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:13:28 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:13:28 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:13:28 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260" returned: 0 in 0.031s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ecdd50-ec98-4b08-b85b-92ca5a14f710]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hxRqMVLy\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 08:13:28 user nova-compute[73091]: node.name = iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5
Aug 16 08:13:28 user nova-compute[73091]: node.tpgt = -1
Aug 16 08:13:28 user nova-compute[73091]: node.startup = automatic
Aug 16 08:13:28 user nova-compute[73091]: node.leading_login = No
Aug 16 08:13:28 user nova-compute[73091]: iface.iscsi_ifacename = default
Aug 16 08:13:28 user nova-compute[73091]: iface.net_ifacename = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.ipaddress = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.prefix_len = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.hwaddress = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.transport_name = tcp
Aug 16 08:13:28 user nova-compute[73091]: iface.initiatorname = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.state = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.vlan_id = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.vlan_priority = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.vlan_state = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.iface_num = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.mtu = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.port = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.bootproto = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.subnet_mask = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.gateway = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.dhcp_alt_client_id = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.dhcp_dns = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.dhcp_learn_iqn = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.dhcp_vendor_id_state = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.dhcp_vendor_id = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.dhcp_slp_da = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.fragmentation = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.gratuitous_arp = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.incoming_forwarding = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.tos_state = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.tos = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.ttl = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.delayed_ack = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.tcp_nagle = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.tcp_wsf_state = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.tcp_wsf = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.tcp_timer_scale = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.tcp_timestamp = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.redirect = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.def_task_mgmt_timeout = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.header_digest = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.data_digest = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.immediate_data = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.initial_r2t = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.data_seq_inorder = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.data_pdu_inorder = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.erl = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.max_receive_data_len = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.first_burst_len = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.max_outstanding_r2t = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.max_burst_len = 0
Aug 16 08:13:28 user nova-compute[73091]: iface.chap_auth = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.bidi_chap = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.strict_login_compliance = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.discovery_auth = <empty>
Aug 16 08:13:28 user nova-compute[73091]: iface.discovery_logout = <empty>
Aug 16 08:13:28 user nova-compute[73091]: node.discovery_address = <empty>
Aug 16 08:13:28 user nova-compute[73091]: node.discovery_port = 0
Aug 16 08:13:28 user nova-compute[73091]: node.discovery_type = static
Aug 16 08:13:28 user nova-compute[73091]: node.session.initial_cmdsn = 0
Aug 16 08:13:28 user nova-compute[73091]: node.session.initial_login_retry_max = 8
Aug 16 08:13:28 user nova-compute[73091]: node.session.xmit_thread_priority = -20
Aug 16 08:13:28 user nova-compute[73091]: node.session.cmds_max = 128
Aug 16 08:13:28 user nova-compute[73091]: node.session.queue_depth = 32
Aug 16 08:13:28 user nova-compute[73091]: node.session.nr_sessions = 1
Aug 16 08:13:28 user nova-compute[73091]: node.session.auth.authmethod = CHAP
Aug 16 08:13:28 user nova-compute[73091]: node.session.auth.username = hxRqMVLy
Aug 16 08:13:28 user nova-compute[73091]: node.session.auth.password = ***
Aug 16 08:13:28 user nova-compute[73091]: node.session.auth.username_in = <empty>
Aug 16 08:13:28 user nova-compute[73091]: node.session.auth.password_in = <empty>
Aug 16 08:13:28 user nova-compute[73091]: node.session.auth.chap_algs = MD5
Aug 16 08:13:28 user nova-compute[73091]: node.session.timeo.replacement_timeout = 120
Aug 16 08:13:28 user nova-compute[73091]: node.session.err_timeo.abort_timeout = 15
Aug 16 08:13:28 user nova-compute[73091]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 08:13:28 user nova-compute[73091]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 08:13:28 user nova-compute[73091]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 08:13:28 user nova-compute[73091]: node.session.iscsi.FastAbort = Yes
Aug 16 08:13:28 user nova-compute[73091]: node.session.iscsi.InitialR2T = No
Aug 16 08:13:28 user nova-compute[73091]: node.session.iscsi.ImmediateData = Yes
Aug 16 08:13:28 user nova-compute[73091]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 08:13:28 user nova-compute[73091]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 08:13:28 user nova-compute[73091]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 08:13:28 user nova-compute[73091]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 08:13:28 user nova-compute[73091]: node.session.iscsi.MaxConnections = 1
Aug 16 08:13:28 user nova-compute[73091]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 08:13:28 user nova-compute[73091]: node.session.iscsi.ERL = 0
Aug 16 08:13:28 user nova-compute[73091]: node.session.scan = manual
Aug 16 08:13:28 user nova-compute[73091]: node.session.reopen_max = 0
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].address = 172.16.0.220
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].port = 3260
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].startup = manual
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].tcp.window_size = 524288
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].tcp.type_of_service = 0
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].timeo.logout_timeout = 15
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].timeo.login_timeout = 15
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].timeo.auth_timeout = 45
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].iscsi.DataDigest = None
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].iscsi.IFMarker = No
Aug 16 08:13:28 user nova-compute[73091]: node.conn[0].iscsi.OFMarker = No
Aug 16 08:13:28 user nova-compute[73091]: # END RECORD
Aug 16 08:13:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42ecba8-013d-4db2-88ee-829e85c65911]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3fbad3-77cf-40e0-ae85-2b8acea4602f]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hxRqMVLy {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hxRqMVLy" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7d4e9c-a6e0-4d70-aced-0598a902c2ef]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hxRqMVLy'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[600fe560-febc-452e-88e8-afd1933e60a0]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbf9fb3-502c-49e9-adf0-15b5b9cce291]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:13:28 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:13:28 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:13:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:13:28 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:13:28 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:13:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] HCTL ('33', '0', '0', 0) found on session 16 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d627c2-5d29-409e-8cb1-1270fe139442]: (4, ('0 0 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Searching for a device in session 16 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hxRqMVLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.211s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] <== connect_volume: return (213ms) {'type': 'block', 'scsi_wwn': '26130376137663264', 'path': '/dev/sdb'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130376137663264', 'path': '/dev/sdb'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1769191166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1769191166',id=13,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:12:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c85ea39234954b05a5a5b21cc52b30ec',ramdisk_id='',reservation_id='r-03jttq7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1623646564',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:12:07Z,user_data=None,user_id='196d845c007043b3aead43d76d94df07',uuid=4f76c866-84a8-499c-a96c-21a2d65ca3d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df5af82e-6121-4551-aea4-adf6897bc4e1", "address": "fa:16:3e:49:79:1a", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "vif_mac": "fa:16:3e:49:79:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5af82e-61", "ovs_interfaceid": "df5af82e-6121-4551-aea4-adf6897bc4e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Converting VIF {"id": "df5af82e-6121-4551-aea4-adf6897bc4e1", "address": "fa:16:3e:49:79:1a", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "vif_mac": "fa:16:3e:49:79:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5af82e-61", "ovs_interfaceid": "df5af82e-6121-4551-aea4-adf6897bc4e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:79:1a,bridge_name='br-int',has_traffic_filtering=True,id=df5af82e-6121-4551-aea4-adf6897bc4e1,network=Network(231d0163-8e3c-408f-bc7d-92a34ba1fde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5af82e-61') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.objects.instance [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f76c866-84a8-499c-a96c-21a2d65ca3d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:13:28 user nova-compute[73091]:   <uuid>4f76c866-84a8-499c-a96c-21a2d65ca3d4</uuid>
Aug 16 08:13:28 user nova-compute[73091]:   <name>instance-0000000d</name>
Aug 16 08:13:28 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:13:28 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:13:28 user nova-compute[73091]:   <metadata>
Aug 16 08:13:28 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:13:28 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:13:28 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1769191166</nova:name>
Aug 16 08:13:28 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:13:28</nova:creationTime>
Aug 16 08:13:28 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:13:28 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:13:28 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:13:28 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:13:28 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:13:28 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:13:28 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:13:28 user nova-compute[73091]:       <nova:owner>
Aug 16 08:13:28 user nova-compute[73091]:         <nova:user uuid="196d845c007043b3aead43d76d94df07">tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member</nova:user>
Aug 16 08:13:28 user nova-compute[73091]:         <nova:project uuid="c85ea39234954b05a5a5b21cc52b30ec">tempest-ServerBootFromVolumeStableRescueTest-1623646564</nova:project>
Aug 16 08:13:28 user nova-compute[73091]:       </nova:owner>
Aug 16 08:13:28 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:13:28 user nova-compute[73091]:       <nova:ports>
Aug 16 08:13:28 user nova-compute[73091]:         <nova:port uuid="df5af82e-6121-4551-aea4-adf6897bc4e1">
Aug 16 08:13:28 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 08:13:28 user nova-compute[73091]:         </nova:port>
Aug 16 08:13:28 user nova-compute[73091]:       </nova:ports>
Aug 16 08:13:28 user nova-compute[73091]:     </nova:instance>
Aug 16 08:13:28 user nova-compute[73091]:   </metadata>
Aug 16 08:13:28 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:13:28 user nova-compute[73091]:     <system>
Aug 16 08:13:28 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:13:28 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:13:28 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:13:28 user nova-compute[73091]:       <entry name="serial">4f76c866-84a8-499c-a96c-21a2d65ca3d4</entry>
Aug 16 08:13:28 user nova-compute[73091]:       <entry name="uuid">4f76c866-84a8-499c-a96c-21a2d65ca3d4</entry>
Aug 16 08:13:28 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:13:28 user nova-compute[73091]:     </system>
Aug 16 08:13:28 user nova-compute[73091]:   </sysinfo>
Aug 16 08:13:28 user nova-compute[73091]:   <os>
Aug 16 08:13:28 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:13:28 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:13:28 user nova-compute[73091]:   </os>
Aug 16 08:13:28 user nova-compute[73091]:   <features>
Aug 16 08:13:28 user nova-compute[73091]:     <acpi/>
Aug 16 08:13:28 user nova-compute[73091]:     <apic/>
Aug 16 08:13:28 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:13:28 user nova-compute[73091]:   </features>
Aug 16 08:13:28 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:13:28 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:13:28 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:13:28 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:13:28 user nova-compute[73091]:   </clock>
Aug 16 08:13:28 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:13:28 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:13:28 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:13:28 user nova-compute[73091]:   </cpu>
Aug 16 08:13:28 user nova-compute[73091]:   <devices>
Aug 16 08:13:28 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:13:28 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:13:28 user nova-compute[73091]:       <source dev="/dev/sdb"/>
Aug 16 08:13:28 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:13:28 user nova-compute[73091]:       <serial>5b085feb-a997-40d9-a120-66c7a45b64f5</serial>
Aug 16 08:13:28 user nova-compute[73091]:     </disk>
Aug 16 08:13:28 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:13:28 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:13:28 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/4f76c866-84a8-499c-a96c-21a2d65ca3d4/disk.rescue"/>
Aug 16 08:13:28 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 08:13:28 user nova-compute[73091]:       <boot order="1"/>
Aug 16 08:13:28 user nova-compute[73091]:     </disk>
Aug 16 08:13:28 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:13:28 user nova-compute[73091]:       <mac address="fa:16:3e:49:79:1a"/>
Aug 16 08:13:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:13:28 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:13:28 user nova-compute[73091]:       <target dev="tapdf5af82e-61"/>
Aug 16 08:13:28 user nova-compute[73091]:     </interface>
Aug 16 08:13:28 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:13:28 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/4f76c866-84a8-499c-a96c-21a2d65ca3d4/console.log" append="off"/>
Aug 16 08:13:28 user nova-compute[73091]:     </serial>
Aug 16 08:13:28 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:13:28 user nova-compute[73091]:     <video>
Aug 16 08:13:28 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:13:28 user nova-compute[73091]:     </video>
Aug 16 08:13:28 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:13:28 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:13:28 user nova-compute[73091]:     </rng>
Aug 16 08:13:28 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:13:28 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:13:28 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:13:28 user nova-compute[73091]:     </memballoon>
Aug 16 08:13:28 user nova-compute[73091]:   </devices>
Aug 16 08:13:28 user nova-compute[73091]: </domain>
Aug 16 08:13:28 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:13:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Instance destroyed successfully.
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] No VIF found with MAC fa:16:3e:49:79:1a, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating instance_info_cache with network_info: [{"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Releasing lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:13:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:13:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "935af9fd-600a-4c48-873b-b39126081748" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "935af9fd-600a-4c48-873b-b39126081748" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:13:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:32 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:13:32 user nova-compute[73091]: INFO nova.compute.claims [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Claim successful on node user
Aug 16 08:13:32 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Removed pending event for 4f76c866-84a8-499c-a96c-21a2d65ca3d4 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 08:13:32 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173612.6384497, 4f76c866-84a8-499c-a96c-21a2d65ca3d4 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:13:32 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] VM Resumed (Lifecycle Event)
Aug 16 08:13:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-e0a5a54a-a6a9-4fbd-8cff-733f9fb0afca tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:13:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:13:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:13:32 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 08:13:32 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173612.6446562, 4f76c866-84a8-499c-a96c-21a2d65ca3d4 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:13:32 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] VM Started (Lifecycle Event)
Aug 16 08:13:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:13:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:13:32 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 08:13:33 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:13:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:13:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG nova.policy [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '193403aa9c4549cd936453ab6ef9c1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84db3210bb264fa8a51ff058417879cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:13:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Creating image(s)
Aug 16 08:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "/opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "/opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "/opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.207s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk 1073741824" returned: 0 in 0.057s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:33 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Successfully created port: 89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-9fb25708-5da0-44eb-af23-66ad64c15798 req-60604d09-d8a4-4afc-b7c3-49299aaa0f34 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9fb25708-5da0-44eb-af23-66ad64c15798 req-60604d09-d8a4-4afc-b7c3-49299aaa0f34 service nova] Acquiring lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9fb25708-5da0-44eb-af23-66ad64c15798 req-60604d09-d8a4-4afc-b7c3-49299aaa0f34 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9fb25708-5da0-44eb-af23-66ad64c15798 req-60604d09-d8a4-4afc-b7c3-49299aaa0f34 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG nova.compute.manager [req-9fb25708-5da0-44eb-af23-66ad64c15798 req-60604d09-d8a4-4afc-b7c3-49299aaa0f34 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] No waiting events found dispatching network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:13:34 user nova-compute[73091]: WARNING nova.compute.manager [req-9fb25708-5da0-44eb-af23-66ad64c15798 req-60604d09-d8a4-4afc-b7c3-49299aaa0f34 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received unexpected event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 for instance with vm_state rescued and task_state None.
Aug 16 08:13:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Cannot resize image /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lazy-loading 'migration_context' on Instance uuid 935af9fd-600a-4c48-873b-b39126081748 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Ensure instance console log exists: /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Successfully updated port: 89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "refresh_cache-935af9fd-600a-4c48-873b-b39126081748" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquired lock "refresh_cache-935af9fd-600a-4c48-873b-b39126081748" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-c24a8958-b16f-48cf-962f-b2ab1a36cb70 req-9ea60ff8-7038-4723-af8a-5e441af0dc03 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Received event network-changed-89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-c24a8958-b16f-48cf-962f-b2ab1a36cb70 req-9ea60ff8-7038-4723-af8a-5e441af0dc03 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Refreshing instance network info cache due to event network-changed-89db23e2-7d11-40dc-8403-4b0ccbc968de. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c24a8958-b16f-48cf-962f-b2ab1a36cb70 req-9ea60ff8-7038-4723-af8a-5e441af0dc03 service nova] Acquiring lock "refresh_cache-935af9fd-600a-4c48-873b-b39126081748" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Updating instance_info_cache with network_info: [{"id": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "address": "fa:16:3e:33:9d:17", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89db23e2-7d", "ovs_interfaceid": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Releasing lock "refresh_cache-935af9fd-600a-4c48-873b-b39126081748" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Instance network_info: |[{"id": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "address": "fa:16:3e:33:9d:17", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89db23e2-7d", "ovs_interfaceid": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c24a8958-b16f-48cf-962f-b2ab1a36cb70 req-9ea60ff8-7038-4723-af8a-5e441af0dc03 service nova] Acquired lock "refresh_cache-935af9fd-600a-4c48-873b-b39126081748" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-c24a8958-b16f-48cf-962f-b2ab1a36cb70 req-9ea60ff8-7038-4723-af8a-5e441af0dc03 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Refreshing network info cache for port 89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Start _get_guest_xml network_info=[{"id": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "address": "fa:16:3e:33:9d:17", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89db23e2-7d", "ovs_interfaceid": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:13:35 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:13:35 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:13:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1638336219',display_name='tempest-VolumesAdminNegativeTest-server-1638336219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1638336219',id=16,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOd3AtDA5xEO6EP+ZK1IVxaUX/eC3damMarqsWPunQGu1OhKEsQd3zawBvy8/ARjb7Tthlpp2gj4H029c62dlmtQ5Hn6MpmtVYY45WvPTkadR39xr1yzp/jyCYBTG4hZkA==',key_name='tempest-keypair-1803670635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84db3210bb264fa8a51ff058417879cf',ramdisk_id='',reservation_id='r-kxyoav4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-285658015',owner_user_name='tempest-VolumesAdminNegativeTest-285658015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:13:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='193403aa9c4549cd936453ab6ef9c1d1',uuid=935af9fd-600a-4c48-873b-b39126081748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "address": "fa:16:3e:33:9d:17", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89db23e2-7d", "ovs_interfaceid": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Converting VIF {"id": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "address": "fa:16:3e:33:9d:17", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89db23e2-7d", "ovs_interfaceid": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:9d:17,bridge_name='br-int',has_traffic_filtering=True,id=89db23e2-7d11-40dc-8403-4b0ccbc968de,network=Network(323e7b6f-721c-4ee0-aa42-fea90e1b7e97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89db23e2-7d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.objects.instance [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lazy-loading 'pci_devices' on Instance uuid 935af9fd-600a-4c48-873b-b39126081748 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:13:35 user nova-compute[73091]:   <uuid>935af9fd-600a-4c48-873b-b39126081748</uuid>
Aug 16 08:13:35 user nova-compute[73091]:   <name>instance-00000010</name>
Aug 16 08:13:35 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:13:35 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:13:35 user nova-compute[73091]:   <metadata>
Aug 16 08:13:35 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:13:35 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:13:35 user nova-compute[73091]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1638336219</nova:name>
Aug 16 08:13:35 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:13:35</nova:creationTime>
Aug 16 08:13:35 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:13:35 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:13:35 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:13:35 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:13:35 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:13:35 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:13:35 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:13:35 user nova-compute[73091]:       <nova:owner>
Aug 16 08:13:35 user nova-compute[73091]:         <nova:user uuid="193403aa9c4549cd936453ab6ef9c1d1">tempest-VolumesAdminNegativeTest-285658015-project-member</nova:user>
Aug 16 08:13:35 user nova-compute[73091]:         <nova:project uuid="84db3210bb264fa8a51ff058417879cf">tempest-VolumesAdminNegativeTest-285658015</nova:project>
Aug 16 08:13:35 user nova-compute[73091]:       </nova:owner>
Aug 16 08:13:35 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:13:35 user nova-compute[73091]:       <nova:ports>
Aug 16 08:13:35 user nova-compute[73091]:         <nova:port uuid="89db23e2-7d11-40dc-8403-4b0ccbc968de">
Aug 16 08:13:35 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 08:13:35 user nova-compute[73091]:         </nova:port>
Aug 16 08:13:35 user nova-compute[73091]:       </nova:ports>
Aug 16 08:13:35 user nova-compute[73091]:     </nova:instance>
Aug 16 08:13:35 user nova-compute[73091]:   </metadata>
Aug 16 08:13:35 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:13:35 user nova-compute[73091]:     <system>
Aug 16 08:13:35 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:13:35 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:13:35 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:13:35 user nova-compute[73091]:       <entry name="serial">935af9fd-600a-4c48-873b-b39126081748</entry>
Aug 16 08:13:35 user nova-compute[73091]:       <entry name="uuid">935af9fd-600a-4c48-873b-b39126081748</entry>
Aug 16 08:13:35 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:13:35 user nova-compute[73091]:     </system>
Aug 16 08:13:35 user nova-compute[73091]:   </sysinfo>
Aug 16 08:13:35 user nova-compute[73091]:   <os>
Aug 16 08:13:35 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:13:35 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:13:35 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:13:35 user nova-compute[73091]:   </os>
Aug 16 08:13:35 user nova-compute[73091]:   <features>
Aug 16 08:13:35 user nova-compute[73091]:     <acpi/>
Aug 16 08:13:35 user nova-compute[73091]:     <apic/>
Aug 16 08:13:35 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:13:35 user nova-compute[73091]:   </features>
Aug 16 08:13:35 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:13:35 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:13:35 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:13:35 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:13:35 user nova-compute[73091]:   </clock>
Aug 16 08:13:35 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:13:35 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:13:35 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:13:35 user nova-compute[73091]:   </cpu>
Aug 16 08:13:35 user nova-compute[73091]:   <devices>
Aug 16 08:13:35 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:13:35 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:13:35 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk"/>
Aug 16 08:13:35 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:13:35 user nova-compute[73091]:     </disk>
Aug 16 08:13:35 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:13:35 user nova-compute[73091]:       <mac address="fa:16:3e:33:9d:17"/>
Aug 16 08:13:35 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:13:35 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:13:35 user nova-compute[73091]:       <target dev="tap89db23e2-7d"/>
Aug 16 08:13:35 user nova-compute[73091]:     </interface>
Aug 16 08:13:35 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:13:35 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/console.log" append="off"/>
Aug 16 08:13:35 user nova-compute[73091]:     </serial>
Aug 16 08:13:35 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:13:35 user nova-compute[73091]:     <video>
Aug 16 08:13:35 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:13:35 user nova-compute[73091]:     </video>
Aug 16 08:13:35 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:13:35 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:13:35 user nova-compute[73091]:     </rng>
Aug 16 08:13:35 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:13:35 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:13:35 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:13:35 user nova-compute[73091]:     </memballoon>
Aug 16 08:13:35 user nova-compute[73091]:   </devices>
Aug 16 08:13:35 user nova-compute[73091]: </domain>
Aug 16 08:13:35 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:13:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1638336219',display_name='tempest-VolumesAdminNegativeTest-server-1638336219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1638336219',id=16,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOd3AtDA5xEO6EP+ZK1IVxaUX/eC3damMarqsWPunQGu1OhKEsQd3zawBvy8/ARjb7Tthlpp2gj4H029c62dlmtQ5Hn6MpmtVYY45WvPTkadR39xr1yzp/jyCYBTG4hZkA==',key_name='tempest-keypair-1803670635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84db3210bb264fa8a51ff058417879cf',ramdisk_id='',reservation_id='r-kxyoav4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-285658015',owner_user_name='tempest-VolumesAdminNegativeTest-285658015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:13:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='193403aa9c4549cd936453ab6ef9c1d1',uuid=935af9fd-600a-4c48-873b-b39126081748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "address": "fa:16:3e:33:9d:17", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89db23e2-7d", "ovs_interfaceid": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Converting VIF {"id": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "address": "fa:16:3e:33:9d:17", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89db23e2-7d", "ovs_interfaceid": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:9d:17,bridge_name='br-int',has_traffic_filtering=True,id=89db23e2-7d11-40dc-8403-4b0ccbc968de,network=Network(323e7b6f-721c-4ee0-aa42-fea90e1b7e97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89db23e2-7d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG os_vif [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:9d:17,bridge_name='br-int',has_traffic_filtering=True,id=89db23e2-7d11-40dc-8403-4b0ccbc968de,network=Network(323e7b6f-721c-4ee0-aa42-fea90e1b7e97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89db23e2-7d') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89db23e2-7d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89db23e2-7d, col_values=(('external_ids', {'iface-id': '89db23e2-7d11-40dc-8403-4b0ccbc968de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:9d:17', 'vm-uuid': '935af9fd-600a-4c48-873b-b39126081748'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:35 user nova-compute[73091]: INFO os_vif [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:9d:17,bridge_name='br-int',has_traffic_filtering=True,id=89db23e2-7d11-40dc-8403-4b0ccbc968de,network=Network(323e7b6f-721c-4ee0-aa42-fea90e1b7e97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89db23e2-7d')
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] No VIF found with MAC fa:16:3e:33:9d:17, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-c24a8958-b16f-48cf-962f-b2ab1a36cb70 req-9ea60ff8-7038-4723-af8a-5e441af0dc03 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Updated VIF entry in instance network info cache for port 89db23e2-7d11-40dc-8403-4b0ccbc968de. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG nova.network.neutron [req-c24a8958-b16f-48cf-962f-b2ab1a36cb70 req-9ea60ff8-7038-4723-af8a-5e441af0dc03 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Updating instance_info_cache with network_info: [{"id": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "address": "fa:16:3e:33:9d:17", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89db23e2-7d", "ovs_interfaceid": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:13:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c24a8958-b16f-48cf-962f-b2ab1a36cb70 req-9ea60ff8-7038-4723-af8a-5e441af0dc03 service nova] Releasing lock "refresh_cache-935af9fd-600a-4c48-873b-b39126081748" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:13:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-9d7ecb3e-ae87-48c3-8af8-e07f3692b5e6 req-fd8904c0-cbdc-4a86-a484-9e801748eda3 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9d7ecb3e-ae87-48c3-8af8-e07f3692b5e6 req-fd8904c0-cbdc-4a86-a484-9e801748eda3 service nova] Acquiring lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9d7ecb3e-ae87-48c3-8af8-e07f3692b5e6 req-fd8904c0-cbdc-4a86-a484-9e801748eda3 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9d7ecb3e-ae87-48c3-8af8-e07f3692b5e6 req-fd8904c0-cbdc-4a86-a484-9e801748eda3 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-9d7ecb3e-ae87-48c3-8af8-e07f3692b5e6 req-fd8904c0-cbdc-4a86-a484-9e801748eda3 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] No waiting events found dispatching network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:13:36 user nova-compute[73091]: WARNING nova.compute.manager [req-9d7ecb3e-ae87-48c3-8af8-e07f3692b5e6 req-fd8904c0-cbdc-4a86-a484-9e801748eda3 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received unexpected event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 for instance with vm_state rescued and task_state None.
Aug 16 08:13:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-44dd9cba-fae7-4b14-9b02-6448f5c4a0f5 req-30e24fcd-3779-495e-b7d3-8a4ca7bb662b service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Received event network-vif-plugged-89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-44dd9cba-fae7-4b14-9b02-6448f5c4a0f5 req-30e24fcd-3779-495e-b7d3-8a4ca7bb662b service nova] Acquiring lock "935af9fd-600a-4c48-873b-b39126081748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-44dd9cba-fae7-4b14-9b02-6448f5c4a0f5 req-30e24fcd-3779-495e-b7d3-8a4ca7bb662b service nova] Lock "935af9fd-600a-4c48-873b-b39126081748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-44dd9cba-fae7-4b14-9b02-6448f5c4a0f5 req-30e24fcd-3779-495e-b7d3-8a4ca7bb662b service nova] Lock "935af9fd-600a-4c48-873b-b39126081748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-44dd9cba-fae7-4b14-9b02-6448f5c4a0f5 req-30e24fcd-3779-495e-b7d3-8a4ca7bb662b service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] No waiting events found dispatching network-vif-plugged-89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:13:37 user nova-compute[73091]: WARNING nova.compute.manager [req-44dd9cba-fae7-4b14-9b02-6448f5c4a0f5 req-30e24fcd-3779-495e-b7d3-8a4ca7bb662b service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Received unexpected event network-vif-plugged-89db23e2-7d11-40dc-8403-4b0ccbc968de for instance with vm_state building and task_state spawning.
Aug 16 08:13:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-9d14c5ca-1b43-40d6-bdfd-1bb58ae25812 req-e710e561-3552-4c2b-8df2-9829a73e2235 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Received event network-vif-plugged-89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9d14c5ca-1b43-40d6-bdfd-1bb58ae25812 req-e710e561-3552-4c2b-8df2-9829a73e2235 service nova] Acquiring lock "935af9fd-600a-4c48-873b-b39126081748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9d14c5ca-1b43-40d6-bdfd-1bb58ae25812 req-e710e561-3552-4c2b-8df2-9829a73e2235 service nova] Lock "935af9fd-600a-4c48-873b-b39126081748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9d14c5ca-1b43-40d6-bdfd-1bb58ae25812 req-e710e561-3552-4c2b-8df2-9829a73e2235 service nova] Lock "935af9fd-600a-4c48-873b-b39126081748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-9d14c5ca-1b43-40d6-bdfd-1bb58ae25812 req-e710e561-3552-4c2b-8df2-9829a73e2235 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] No waiting events found dispatching network-vif-plugged-89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:13:39 user nova-compute[73091]: WARNING nova.compute.manager [req-9d14c5ca-1b43-40d6-bdfd-1bb58ae25812 req-e710e561-3552-4c2b-8df2-9829a73e2235 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Received unexpected event network-vif-plugged-89db23e2-7d11-40dc-8403-4b0ccbc968de for instance with vm_state building and task_state spawning.
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173619.2731888, 935af9fd-600a-4c48-873b-b39126081748 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:13:39 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 935af9fd-600a-4c48-873b-b39126081748] VM Resumed (Lifecycle Event)
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 935af9fd-600a-4c48-873b-b39126081748] Instance spawned successfully.
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 935af9fd-600a-4c48-873b-b39126081748] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 935af9fd-600a-4c48-873b-b39126081748] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:13:39 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 935af9fd-600a-4c48-873b-b39126081748] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173619.2734914, 935af9fd-600a-4c48-873b-b39126081748 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:13:39 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 935af9fd-600a-4c48-873b-b39126081748] VM Started (Lifecycle Event)
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 935af9fd-600a-4c48-873b-b39126081748] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 935af9fd-600a-4c48-873b-b39126081748] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:13:39 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 935af9fd-600a-4c48-873b-b39126081748] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:13:39 user nova-compute[73091]: INFO nova.compute.manager [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Took 5.99 seconds to spawn the instance on the hypervisor.
Aug 16 08:13:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:13:39 user nova-compute[73091]: INFO nova.compute.manager [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Took 7.06 seconds to build instance.
Aug 16 08:13:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-0f478499-e99d-4c36-8f16-4a50bb9c9455 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "935af9fd-600a-4c48-873b-b39126081748" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.188s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "58fb6a40-f818-4515-be92-9f5dd96e40d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:51 user nova-compute[73091]: INFO nova.compute.manager [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Terminating instance
Aug 16 08:13:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 08:13:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:51 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-2a830895-6e60-4e87-94c2-4345cdb039d6 req-25c0709c-ceaf-4bef-8392-57aa0a3abb4f service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received event network-vif-unplugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2a830895-6e60-4e87-94c2-4345cdb039d6 req-25c0709c-ceaf-4bef-8392-57aa0a3abb4f service nova] Acquiring lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2a830895-6e60-4e87-94c2-4345cdb039d6 req-25c0709c-ceaf-4bef-8392-57aa0a3abb4f service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2a830895-6e60-4e87-94c2-4345cdb039d6 req-25c0709c-ceaf-4bef-8392-57aa0a3abb4f service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-2a830895-6e60-4e87-94c2-4345cdb039d6 req-25c0709c-ceaf-4bef-8392-57aa0a3abb4f service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] No waiting events found dispatching network-vif-unplugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-2a830895-6e60-4e87-94c2-4345cdb039d6 req-25c0709c-ceaf-4bef-8392-57aa0a3abb4f service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received event network-vif-unplugged-ff7593ef-acd3-4f60-8f85-e4314751d437 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:13:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Instance destroyed successfully.
Aug 16 08:13:52 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lazy-loading 'resources' on Instance uuid 58fb6a40-f818-4515-be92-9f5dd96e40d6 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T08:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-161383938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-622705224',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgwr+lPrpEP5o9ETv2V1lYpdSx5+1jSfz5g40qSuKvSXhEDtmL9vrp71E/TIr7O7WlZ5kcRETw3PrK7xu+z/FUuEGZhJeo4ndVNxGCXeTwKuExSPw6ICDcnszQlQ44bDg==',key_name='tempest-keypair-1739562332',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:11:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3cd0afcf7cd4d06b6914fd69282e6df',ramdisk_id='',reservation_id='r-j2kcg45t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1659459997',owner_user_name='tempest-ServerActionsV293TestJSON-1659459997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:12:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb81b27063f549ab938bea843a3ed7c6',uuid=58fb6a40-f818-4515-be92-9f5dd96e40d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Converting VIF {"id": "ff7593ef-acd3-4f60-8f85-e4314751d437", "address": "fa:16:3e:ba:e5:eb", "network": {"id": "38194120-0573-40dd-a8f9-78e2afcb9e29", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2043499724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd0afcf7cd4d06b6914fd69282e6df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7593ef-ac", "ovs_interfaceid": "ff7593ef-acd3-4f60-8f85-e4314751d437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:e5:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff7593ef-acd3-4f60-8f85-e4314751d437,network=Network(38194120-0573-40dd-a8f9-78e2afcb9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7593ef-ac') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_vif [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:e5:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff7593ef-acd3-4f60-8f85-e4314751d437,network=Network(38194120-0573-40dd-a8f9-78e2afcb9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7593ef-ac') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff7593ef-ac, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:13:52 user nova-compute[73091]: INFO os_vif [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:e5:eb,bridge_name='br-int',has_traffic_filtering=True,id=ff7593ef-acd3-4f60-8f85-e4314751d437,network=Network(38194120-0573-40dd-a8f9-78e2afcb9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7593ef-ac')
Aug 16 08:13:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWKlGuEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:13:52 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[50094345-7039-4fa9-967f-f82c4831d369]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[811b7b4a-1dba-4359-83b0-939218137916]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:13:52 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:13:52 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:13:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 (non-flash)
Aug 16 08:13:52 user nova-compute[73091]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:13:52 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:13:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8cc582050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59'): ({'sdi'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Removing single pathed devices sdi {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4965031d-e011-4805-885b-0f996490aac5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.027s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3166857-cab9-44b5-af42-c9316e5cea1a]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Flushing IO for device /dev/sdi {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c0ccc6-ae21-4c5a-8d41-37c3d17e38dd]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e237ad31-47d4-4c2e-a4a7-af063e7632dd]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] SCSI volumes sdi have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2d9ebef6', '/dev/disk/by-id/scsi-1SCST_BIO2d9ebef6-d98588e9d2bbaef6', '/dev/disk/by-id/scsi-26439383538386539') {{(pid=83685) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 08:13:52 user nova-compute[73091]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_2d9ebef6
Aug 16 08:13:52 user nova-compute[73091]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO2d9ebef6-d98588e9d2bbaef6
Aug 16 08:13:52 user nova-compute[73091]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26439383538386539
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e24664-e52d-4f99-a017-12a162a8d351]: (4, None) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2e1562-29b2-4ed6-8338-4efdf1d97c95]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[470b45ee-fd37-489e-a6dc-b6c68dc5a674]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260]
Aug 16 08:13:52 user nova-compute[73091]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59, portal: 172.16.0.220,3260] successful.
Aug 16 08:13:52 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3e8806-d7ec-4a38-8db5-24c779243859]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] <== disconnect_volume: return (351ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:13:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:13:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Deleting instance files /opt/stack/data/nova/instances/58fb6a40-f818-4515-be92-9f5dd96e40d6_del
Aug 16 08:13:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Deletion of /opt/stack/data/nova/instances/58fb6a40-f818-4515-be92-9f5dd96e40d6_del complete
Aug 16 08:13:53 user nova-compute[73091]: INFO nova.compute.manager [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 16 08:13:53 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 08:13:53 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 08:13:53 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 08:13:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-6d0acdb5-585d-4302-85f4-4b4f0154fd3a req-266ce51d-8511-467f-81ae-fd797dc1e94a service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received event network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6d0acdb5-585d-4302-85f4-4b4f0154fd3a req-266ce51d-8511-467f-81ae-fd797dc1e94a service nova] Acquiring lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6d0acdb5-585d-4302-85f4-4b4f0154fd3a req-266ce51d-8511-467f-81ae-fd797dc1e94a service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6d0acdb5-585d-4302-85f4-4b4f0154fd3a req-266ce51d-8511-467f-81ae-fd797dc1e94a service nova] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-6d0acdb5-585d-4302-85f4-4b4f0154fd3a req-266ce51d-8511-467f-81ae-fd797dc1e94a service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] No waiting events found dispatching network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:13:54 user nova-compute[73091]: WARNING nova.compute.manager [req-6d0acdb5-585d-4302-85f4-4b4f0154fd3a req-266ce51d-8511-467f-81ae-fd797dc1e94a service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received unexpected event network-vif-plugged-ff7593ef-acd3-4f60-8f85-e4314751d437 for instance with vm_state active and task_state deleting.
Aug 16 08:13:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:54 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:13:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-210697b0-ad4e-40be-85a7-39173fab32ae req-da02c99a-be0c-406b-8d2b-0b199eeff4f7 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Received event network-vif-deleted-ff7593ef-acd3-4f60-8f85-e4314751d437 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:13:54 user nova-compute[73091]: INFO nova.compute.manager [req-210697b0-ad4e-40be-85a7-39173fab32ae req-da02c99a-be0c-406b-8d2b-0b199eeff4f7 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Neutron deleted interface ff7593ef-acd3-4f60-8f85-e4314751d437; detaching it from the instance and deleting it from the info cache
Aug 16 08:13:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-210697b0-ad4e-40be-85a7-39173fab32ae req-da02c99a-be0c-406b-8d2b-0b199eeff4f7 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:13:54 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Took 1.74 seconds to deallocate network for instance.
Aug 16 08:13:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-210697b0-ad4e-40be-85a7-39173fab32ae req-da02c99a-be0c-406b-8d2b-0b199eeff4f7 service nova] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Detach interface failed, port_id=ff7593ef-acd3-4f60-8f85-e4314751d437, reason: Instance 58fb6a40-f818-4515-be92-9f5dd96e40d6 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 08:13:55 user nova-compute[73091]: INFO nova.compute.manager [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Took 1.04 seconds to detach 1 volumes for instance.
Aug 16 08:13:55 user nova-compute[73091]: DEBUG nova.compute.manager [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Deleting volume: 2c00710f-993d-47dc-b3a1-5f6b2e1ccd59 {{(pid=73091) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 08:13:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:13:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:13:56 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:13:56 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:13:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:56 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Deleted allocations for instance 58fb6a40-f818-4515-be92-9f5dd96e40d6
Aug 16 08:13:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3b0a3e3e-b0e7-4914-8ca2-8295a1d08359 tempest-ServerActionsV293TestJSON-1659459997 tempest-ServerActionsV293TestJSON-1659459997-project-member] Lock "58fb6a40-f818-4515-be92-9f5dd96e40d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.895s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:13:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:13:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:07 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173632.4439557, 58fb6a40-f818-4515-be92-9f5dd96e40d6 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:14:07 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] VM Stopped (Lifecycle Event)
Aug 16 08:14:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-542f050a-eb44-4ee8-8ae3-71afe37d6d1b None None] [instance: 58fb6a40-f818-4515-be92-9f5dd96e40d6] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:14:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-320b0654-2c47-47e2-b880-783b5dba9941 req-138ebba2-810a-4fcc-b3eb-565216aae68e service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received event network-changed-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:14:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-320b0654-2c47-47e2-b880-783b5dba9941 req-138ebba2-810a-4fcc-b3eb-565216aae68e service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Refreshing instance network info cache due to event network-changed-439b29b8-64e3-40fe-b28b-0f8e05155ab6. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:14:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-320b0654-2c47-47e2-b880-783b5dba9941 req-138ebba2-810a-4fcc-b3eb-565216aae68e service nova] Acquiring lock "refresh_cache-18850651-02ac-459a-838c-b3216bcbe131" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:14:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-320b0654-2c47-47e2-b880-783b5dba9941 req-138ebba2-810a-4fcc-b3eb-565216aae68e service nova] Acquired lock "refresh_cache-18850651-02ac-459a-838c-b3216bcbe131" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:14:17 user nova-compute[73091]: DEBUG nova.network.neutron [req-320b0654-2c47-47e2-b880-783b5dba9941 req-138ebba2-810a-4fcc-b3eb-565216aae68e service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Refreshing network info cache for port 439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:14:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-320b0654-2c47-47e2-b880-783b5dba9941 req-138ebba2-810a-4fcc-b3eb-565216aae68e service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Updated VIF entry in instance network info cache for port 439b29b8-64e3-40fe-b28b-0f8e05155ab6. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:14:18 user nova-compute[73091]: DEBUG nova.network.neutron [req-320b0654-2c47-47e2-b880-783b5dba9941 req-138ebba2-810a-4fcc-b3eb-565216aae68e service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Updating instance_info_cache with network_info: [{"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:14:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-320b0654-2c47-47e2-b880-783b5dba9941 req-138ebba2-810a-4fcc-b3eb-565216aae68e service nova] Releasing lock "refresh_cache-18850651-02ac-459a-838c-b3216bcbe131" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "18850651-02ac-459a-838c-b3216bcbe131" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG nova.objects.instance [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lazy-loading 'flavor' on Instance uuid 18850651-02ac-459a-838c-b3216bcbe131 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "18850651-02ac-459a-838c-b3216bcbe131" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "18850651-02ac-459a-838c-b3216bcbe131" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:19 user nova-compute[73091]: INFO nova.compute.manager [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Attaching volume 10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 to /dev/vdb
Aug 16 08:14:19 user nova-compute[73091]: DEBUG os_brick.utils [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff8983c-57af-4d48-8820-6c0c4c1393c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e45cd18-d15a-44c6-aeb1-a72211d9152d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13c1430-f1e7-4bbe-afe2-897d89c6bf84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1bfb7c-278a-47d4-9120-bfb9706e7d60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:14:19 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:14:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf271e4-cd21-4b17-832d-ffd765bfd0f3]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG os_brick.utils [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:14:19 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Updating existing volume attachment record: 0f30182e-0c72-4fda-8bf2-d9a7ab256fc9 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:14:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:14:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:14:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:14:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquiring lock "6060dcaf-e451-4308-b96f-43bcbf56d621" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquiring lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:23 user nova-compute[73091]: INFO nova.compute.manager [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Terminating instance
Aug 16 08:14:23 user nova-compute[73091]: DEBUG nova.compute.manager [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-b1790aa7-305b-4cac-83d0-98d23072e93f req-9ded0547-1d5e-40e5-b1a1-00371dda7187 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-vif-unplugged-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b1790aa7-305b-4cac-83d0-98d23072e93f req-9ded0547-1d5e-40e5-b1a1-00371dda7187 service nova] Acquiring lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b1790aa7-305b-4cac-83d0-98d23072e93f req-9ded0547-1d5e-40e5-b1a1-00371dda7187 service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b1790aa7-305b-4cac-83d0-98d23072e93f req-9ded0547-1d5e-40e5-b1a1-00371dda7187 service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-b1790aa7-305b-4cac-83d0-98d23072e93f req-9ded0547-1d5e-40e5-b1a1-00371dda7187 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] No waiting events found dispatching network-vif-unplugged-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-b1790aa7-305b-4cac-83d0-98d23072e93f req-9ded0547-1d5e-40e5-b1a1-00371dda7187 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-vif-unplugged-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-0f3d2d40-78af-48f3-97b3-48fa16f13da3 req-9c844167-ff5e-46cf-a962-f54af5e12d03 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-vif-unplugged-484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0f3d2d40-78af-48f3-97b3-48fa16f13da3 req-9c844167-ff5e-46cf-a962-f54af5e12d03 service nova] Acquiring lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0f3d2d40-78af-48f3-97b3-48fa16f13da3 req-9c844167-ff5e-46cf-a962-f54af5e12d03 service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0f3d2d40-78af-48f3-97b3-48fa16f13da3 req-9c844167-ff5e-46cf-a962-f54af5e12d03 service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-0f3d2d40-78af-48f3-97b3-48fa16f13da3 req-9c844167-ff5e-46cf-a962-f54af5e12d03 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] No waiting events found dispatching network-vif-unplugged-484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-0f3d2d40-78af-48f3-97b3-48fa16f13da3 req-9c844167-ff5e-46cf-a962-f54af5e12d03 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-vif-unplugged-484c8e2e-4293-41a9-af3c-a6ceb2221a66 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Instance destroyed successfully.
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lazy-loading 'resources' on Instance uuid 6060dcaf-e451-4308-b96f-43bcbf56d621 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-533383333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-533383333',id=8,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVA21kXfGbBZ8tCkmT8f3te1Beei+c1JBZA9yX2YdMqwQ7rOdytqAnah4ggCfCIOD5TJSFrM/TOy12XBf1vQaZu3PTuMiXP/NZi01CNr4OGI2WqEhw1bg2TvGRW+Q0clA==',key_name='tempest-keypair-944206026',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:09:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c792e3e04a0441459b54db9975a0b270',ramdisk_id='',reservation_id='r-0m5hrv3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1641584847',owner_user_name='tempest-TaggedAttachmentsTest-1641584847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3e5cf312ea947d7bd695bea3b892664',uuid=6060dcaf-e451-4308-b96f-43bcbf56d621,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "address": "fa:16:3e:43:ce:db", "network": {"id": "6fa0c4ff-1fbd-499d-ac02-362c7671c238", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-553465889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c8e2e-42", "ovs_interfaceid": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Converting VIF {"id": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "address": "fa:16:3e:43:ce:db", "network": {"id": "6fa0c4ff-1fbd-499d-ac02-362c7671c238", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-553465889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c8e2e-42", "ovs_interfaceid": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:ce:db,bridge_name='br-int',has_traffic_filtering=True,id=484c8e2e-4293-41a9-af3c-a6ceb2221a66,network=Network(6fa0c4ff-1fbd-499d-ac02-362c7671c238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484c8e2e-42') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG os_vif [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:ce:db,bridge_name='br-int',has_traffic_filtering=True,id=484c8e2e-4293-41a9-af3c-a6ceb2221a66,network=Network(6fa0c4ff-1fbd-499d-ac02-362c7671c238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484c8e2e-42') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap484c8e2e-42, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:24 user nova-compute[73091]: INFO os_vif [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:ce:db,bridge_name='br-int',has_traffic_filtering=True,id=484c8e2e-4293-41a9-af3c-a6ceb2221a66,network=Network(6fa0c4ff-1fbd-499d-ac02-362c7671c238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484c8e2e-42')
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T08:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-533383333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-533383333',id=8,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVA21kXfGbBZ8tCkmT8f3te1Beei+c1JBZA9yX2YdMqwQ7rOdytqAnah4ggCfCIOD5TJSFrM/TOy12XBf1vQaZu3PTuMiXP/NZi01CNr4OGI2WqEhw1bg2TvGRW+Q0clA==',key_name='tempest-keypair-944206026',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:09:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c792e3e04a0441459b54db9975a0b270',ramdisk_id='',reservation_id='r-0m5hrv3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1641584847',owner_user_name='tempest-TaggedAttachmentsTest-1641584847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3e5cf312ea947d7bd695bea3b892664',uuid=6060dcaf-e451-4308-b96f-43bcbf56d621,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "address": "fa:16:3e:38:41:7a", "network": {"id": "e3fef4ee-18c1-4e15-863d-d570b9d937ff", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1887518115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08daec2a-bf", "ovs_interfaceid": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Converting VIF {"id": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "address": "fa:16:3e:38:41:7a", "network": {"id": "e3fef4ee-18c1-4e15-863d-d570b9d937ff", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1887518115", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08daec2a-bf", "ovs_interfaceid": "08daec2a-bf29-4d4d-ae4f-7305c9a38f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:41:7a,bridge_name='br-int',has_traffic_filtering=True,id=08daec2a-bf29-4d4d-ae4f-7305c9a38f6e,network=Network(e3fef4ee-18c1-4e15-863d-d570b9d937ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08daec2a-bf') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG os_vif [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:41:7a,bridge_name='br-int',has_traffic_filtering=True,id=08daec2a-bf29-4d4d-ae4f-7305c9a38f6e,network=Network(e3fef4ee-18c1-4e15-863d-d570b9d937ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08daec2a-bf') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08daec2a-bf, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:14:24 user nova-compute[73091]: INFO os_vif [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:41:7a,bridge_name='br-int',has_traffic_filtering=True,id=08daec2a-bf29-4d4d-ae4f-7305c9a38f6e,network=Network(e3fef4ee-18c1-4e15-863d-d570b9d937ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08daec2a-bf')
Aug 16 08:14:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Deleting instance files /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621_del
Aug 16 08:14:24 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Deletion of /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621_del complete
Aug 16 08:14:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json" returned: 1 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk --force-share --output=json' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:14:24 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000008, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/6060dcaf-e451-4308-b96f-43bcbf56d621/disk
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f76c866-84a8-499c-a96c-21a2d65ca3d4/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:24 user nova-compute[73091]: INFO nova.compute.manager [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 16 08:14:24 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f76c866-84a8-499c-a96c-21a2d65ca3d4/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f76c866-84a8-499c-a96c-21a2d65ca3d4/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f76c866-84a8-499c-a96c-21a2d65ca3d4/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:14:25 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:14:25 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=7174MB free_disk=25.390071868896484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:14:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Applying migration context for instance 476de8ea-30dd-4b52-be37-f134e445757f as it has an incoming, in-progress migration d7d5c217-793b-440c-a654-b060f016d306. Migration status is finished {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 08:14:26 user nova-compute[73091]: INFO nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating resource usage from migration d7d5c217-793b-440c-a654-b060f016d306
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-98850971-1698-42f8-8631-a34f641d6dde req-2eb5a927-05ac-4983-afb5-1d3c19781d4b service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-vif-plugged-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98850971-1698-42f8-8631-a34f641d6dde req-2eb5a927-05ac-4983-afb5-1d3c19781d4b service nova] Acquiring lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98850971-1698-42f8-8631-a34f641d6dde req-2eb5a927-05ac-4983-afb5-1d3c19781d4b service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-98850971-1698-42f8-8631-a34f641d6dde req-2eb5a927-05ac-4983-afb5-1d3c19781d4b service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-98850971-1698-42f8-8631-a34f641d6dde req-2eb5a927-05ac-4983-afb5-1d3c19781d4b service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] No waiting events found dispatching network-vif-plugged-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:14:26 user nova-compute[73091]: WARNING nova.compute.manager [req-98850971-1698-42f8-8631-a34f641d6dde req-2eb5a927-05ac-4983-afb5-1d3c19781d4b service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received unexpected event network-vif-plugged-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e for instance with vm_state active and task_state deleting.
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance bd541280-cecf-4c1c-bd1f-f7edff830f1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4a6248b9-f577-4efd-baa2-eb5eb3e47495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance cc7973d9-c703-4345-bf58-ccbe80fd07ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance daf2b789-eba2-419b-99f6-be8f483151ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 6060dcaf-e451-4308-b96f-43bcbf56d621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4f76c866-84a8-499c-a96c-21a2d65ca3d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 18850651-02ac-459a-838c-b3216bcbe131 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 7aded393-c408-48d9-a30c-78b62ce0d09e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Migration d7d5c217-793b-440c-a654-b060f016d306 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 476de8ea-30dd-4b52-be37-f134e445757f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 935af9fd-600a-4c48-873b-b39126081748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-22bf5b04-f1f7-4ac0-8a77-3a9e666efc63 req-c57b3645-e953-490f-b6a7-00a70b3b959f service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-vif-plugged-484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-22bf5b04-f1f7-4ac0-8a77-3a9e666efc63 req-c57b3645-e953-490f-b6a7-00a70b3b959f service nova] Acquiring lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-22bf5b04-f1f7-4ac0-8a77-3a9e666efc63 req-c57b3645-e953-490f-b6a7-00a70b3b959f service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-22bf5b04-f1f7-4ac0-8a77-3a9e666efc63 req-c57b3645-e953-490f-b6a7-00a70b3b959f service nova] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-22bf5b04-f1f7-4ac0-8a77-3a9e666efc63 req-c57b3645-e953-490f-b6a7-00a70b3b959f service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] No waiting events found dispatching network-vif-plugged-484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:14:26 user nova-compute[73091]: WARNING nova.compute.manager [req-22bf5b04-f1f7-4ac0-8a77-3a9e666efc63 req-c57b3645-e953-490f-b6a7-00a70b3b959f service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received unexpected event network-vif-plugged-484c8e2e-4293-41a9-af3c-a6ceb2221a66 for instance with vm_state active and task_state deleting.
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-22bf5b04-f1f7-4ac0-8a77-3a9e666efc63 req-c57b3645-e953-490f-b6a7-00a70b3b959f service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-vif-deleted-08daec2a-bf29-4d4d-ae4f-7305c9a38f6e {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:14:26 user nova-compute[73091]: INFO nova.compute.manager [req-22bf5b04-f1f7-4ac0-8a77-3a9e666efc63 req-c57b3645-e953-490f-b6a7-00a70b3b959f service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Neutron deleted interface 08daec2a-bf29-4d4d-ae4f-7305c9a38f6e; detaching it from the instance and deleting it from the info cache
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-22bf5b04-f1f7-4ac0-8a77-3a9e666efc63 req-c57b3645-e953-490f-b6a7-00a70b3b959f service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Updating instance_info_cache with network_info: [{"id": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "address": "fa:16:3e:43:ce:db", "network": {"id": "6fa0c4ff-1fbd-499d-ac02-362c7671c238", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-553465889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c792e3e04a0441459b54db9975a0b270", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c8e2e-42", "ovs_interfaceid": "484c8e2e-4293-41a9-af3c-a6ceb2221a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-22bf5b04-f1f7-4ac0-8a77-3a9e666efc63 req-c57b3645-e953-490f-b6a7-00a70b3b959f service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Detach interface failed, port_id=08daec2a-bf29-4d4d-ae4f-7305c9a38f6e, reason: Instance 6060dcaf-e451-4308-b96f-43bcbf56d621 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:14:26 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Took 2.16 seconds to deallocate network for instance.
Aug 16 08:14:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:27 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:14:27 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:14:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:27 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Deleted allocations for instance 6060dcaf-e451-4308-b96f-43bcbf56d621
Aug 16 08:14:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ddf24dc-8aac-4f1b-b3ce-64027a54d78c tempest-TaggedAttachmentsTest-1641584847 tempest-TaggedAttachmentsTest-1641584847-project-member] Lock "6060dcaf-e451-4308-b96f-43bcbf56d621" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.031s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:14:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:14:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:14:28 user nova-compute[73091]: DEBUG nova.compute.manager [req-7884bb0c-60ab-4a58-b15d-8cfd63f0d9f0 req-f389524e-c444-4049-b5af-6ca29cae3da2 service nova] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Received event network-vif-deleted-484c8e2e-4293-41a9-af3c-a6ceb2221a66 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:14:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Didn't find any instances for network info cache update. {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 08:14:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:14:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:14:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:14:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:14:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:14:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:14:28 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:14:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 08:14:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Triggering sync for uuid bd541280-cecf-4c1c-bd1f-f7edff830f1e {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Triggering sync for uuid 4a6248b9-f577-4efd-baa2-eb5eb3e47495 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Triggering sync for uuid cc7973d9-c703-4345-bf58-ccbe80fd07ac {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Triggering sync for uuid daf2b789-eba2-419b-99f6-be8f483151ba {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Triggering sync for uuid 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Triggering sync for uuid 4f76c866-84a8-499c-a96c-21a2d65ca3d4 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Triggering sync for uuid 18850651-02ac-459a-838c-b3216bcbe131 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Triggering sync for uuid 7aded393-c408-48d9-a30c-78b62ce0d09e {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Triggering sync for uuid 935af9fd-600a-4c48-873b-b39126081748 {{(pid=73091) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "cc7973d9-c703-4345-bf58-ccbe80fd07ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "cc7973d9-c703-4345-bf58-ccbe80fd07ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "daf2b789-eba2-419b-99f6-be8f483151ba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "daf2b789-eba2-419b-99f6-be8f483151ba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "476de8ea-30dd-4b52-be37-f134e445757f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "7aded393-c408-48d9-a30c-78b62ce0d09e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "935af9fd-600a-4c48-873b-b39126081748" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "935af9fd-600a-4c48-873b-b39126081748" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "4a6248b9-f577-4efd-baa2-eb5eb3e47495" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "476de8ea-30dd-4b52-be37-f134e445757f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "935af9fd-600a-4c48-873b-b39126081748" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "daf2b789-eba2-419b-99f6-be8f483151ba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waVECumk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:14:29 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:14:29 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:14:29 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2ec5e4-1822-40ba-9a43-c8dd76e62876]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:14:29 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "cc7973d9-c703-4345-bf58-ccbe80fd07ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.148s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd99398-c315-4e60-969d-ee75c289b814]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881] added
Aug 16 08:14:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.154s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ae46a2-d225-4b2a-a160-0e75737025d9]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced62b9e-31f4-45df-9c60-88894e1eb4c1]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v waVECumk {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v waVECumk" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bb2699-f105-45ba-840c-34f7c734af46]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'waVECumk'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7727779-e6da-4afb-aa1a-717064baccb0]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b36af8f-bb05-402f-8b13-4de1304fbae7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:29 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:14:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:29 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:14:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[88479840-336c-40e8-a6f4-28c1f2364a6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260]
Aug 16 08:14:29 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260] successful.
Aug 16 08:14:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c70cc15-01e3-4ef7-8abd-d97b163fbab8]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d01502e-8626-4400-9982-079160e8897f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:29 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:14:29 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:14:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:29 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:14:29 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:14:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a15536-3065-488d-b195-a41f8f2cc7ac]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:14:30 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:14:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waVECumk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:14:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:14:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23864643037656335', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:14:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864643037656335', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:14:30 user nova-compute[73091]: DEBUG nova.objects.instance [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lazy-loading 'flavor' on Instance uuid 18850651-02ac-459a-838c-b3216bcbe131 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:14:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 08:14:30 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:14:30 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 16 08:14:30 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:14:30 user nova-compute[73091]:   <serial>10ee6294-f727-4e2b-b6ec-3d1e8a1d7881</serial>
Aug 16 08:14:30 user nova-compute[73091]: </disk>
Aug 16 08:14:30 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 08:14:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:14:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:14:31 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] No VIF found with MAC fa:16:3e:99:72:46, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-da1e91af-31f4-414c-bede-870dfd628075 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "18850651-02ac-459a-838c-b3216bcbe131" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.110s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "18850651-02ac-459a-838c-b3216bcbe131" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.019s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "18850651-02ac-459a-838c-b3216bcbe131" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:33 user nova-compute[73091]: INFO nova.compute.manager [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Rebuilding instance
Aug 16 08:14:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lazy-loading 'trusted_certs' on Instance uuid 18850651-02ac-459a-838c-b3216bcbe131 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:14:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:14:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lazy-loading 'pci_requests' on Instance uuid 18850651-02ac-459a-838c-b3216bcbe131 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:14:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lazy-loading 'pci_devices' on Instance uuid 18850651-02ac-459a-838c-b3216bcbe131 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:14:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lazy-loading 'resources' on Instance uuid 18850651-02ac-459a-838c-b3216bcbe131 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:14:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lazy-loading 'migration_context' on Instance uuid 18850651-02ac-459a-838c-b3216bcbe131 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:14:33 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73091) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 08:14:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-473daa9f-8739-4e5e-8262-b049171fd2e8 req-43c6a64d-f71e-452f-8255-828d03048e25 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received event network-vif-unplugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:14:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-473daa9f-8739-4e5e-8262-b049171fd2e8 req-43c6a64d-f71e-452f-8255-828d03048e25 service nova] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-473daa9f-8739-4e5e-8262-b049171fd2e8 req-43c6a64d-f71e-452f-8255-828d03048e25 service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-473daa9f-8739-4e5e-8262-b049171fd2e8 req-43c6a64d-f71e-452f-8255-828d03048e25 service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:33 user nova-compute[73091]: DEBUG nova.compute.manager [req-473daa9f-8739-4e5e-8262-b049171fd2e8 req-43c6a64d-f71e-452f-8255-828d03048e25 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] No waiting events found dispatching network-vif-unplugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:14:33 user nova-compute[73091]: WARNING nova.compute.manager [req-473daa9f-8739-4e5e-8262-b049171fd2e8 req-43c6a64d-f71e-452f-8255-828d03048e25 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received unexpected event network-vif-unplugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 for instance with vm_state active and task_state rebuilding.
Aug 16 08:14:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Instance destroyed successfully.
Aug 16 08:14:34 user nova-compute[73091]: INFO nova.compute.manager [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Detaching volume 10ee6294-f727-4e2b-b6ec-3d1e8a1d7881
Aug 16 08:14:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:34 user nova-compute[73091]: INFO nova.virt.block_device [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Attempting to driver detach volume 10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 from mountpoint /dev/vdb
Aug 16 08:14:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Attempting to detach device vdb from instance 18850651-02ac-459a-838c-b3216bcbe131 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:14:34 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:14:34 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 16 08:14:34 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:14:34 user nova-compute[73091]:   <serial>10ee6294-f727-4e2b-b6ec-3d1e8a1d7881</serial>
Aug 16 08:14:34 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 08:14:34 user nova-compute[73091]: </disk>
Aug 16 08:14:34 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:14:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Successfully detached device vdb from instance 18850651-02ac-459a-838c-b3216bcbe131 from the persistent domain config.
Aug 16 08:14:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waVECumk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:14:34 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a018fc4d-b6f3-427c-96e3-ae43eca88c55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca49a8ba-a563-465e-8bf2-578f5023fcd2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:34 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:14:34 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:14:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:34 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:14:34 user nova-compute[73091]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:14:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8cc5cf2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36dc29b-811c-4e4e-937b-1296e24aee9f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2a2022-43bf-44c4-b600-da55d30b0ab7]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9b9d01-0717-4c20-977b-a02ddc3d52b8]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[328b06e6-8cae-4589-b10f-88ef25c4beab]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ffaf1d-338c-46ab-aee3-468fe0ce83f8]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1be2dc-51e5-4879-bafd-b2d69a892b17]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260]
Aug 16 08:14:34 user nova-compute[73091]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260] successful.
Aug 16 08:14:34 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfa9062-ad80-4ecb-9d6c-d18a61e4c4b4]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] <== disconnect_volume: return (289ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:14:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:14:35 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Instance destroyed successfully.
Aug 16 08:14:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1764805922',display_name='tempest-ServerActionsTestOtherA-server-652148951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1764805922',id=14,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz3j860Gkv1Slc5oyCWy6VoP7hKNPEjEuai3DW0jmBORKbAqdoKcQLb4MoAKfM8zJIG4wm2vu7GJkTGhorCXdn6cmATTCXJNllAcczoCXr4+3AVbBT7pCqZb5Uvu2XtIw==',key_name='tempest-keypair-502085907',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:12:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fc3a302cc78494296980753b56edb0c',ramdisk_id='',reservation_id='r-wmdyi2tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-534432070',owner_user_name='tempest-ServerActionsTestOtherA-534432070-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:14:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5a61e00249d4bc4b14dd0ab5b88e58c',uuid=18850651-02ac-459a-838c-b3216bcbe131,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converting VIF {"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:72:46,bridge_name='br-int',has_traffic_filtering=True,id=439b29b8-64e3-40fe-b28b-0f8e05155ab6,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap439b29b8-64') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_vif [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:72:46,bridge_name='br-int',has_traffic_filtering=True,id=439b29b8-64e3-40fe-b28b-0f8e05155ab6,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap439b29b8-64') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap439b29b8-64, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:14:35 user nova-compute[73091]: INFO os_vif [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:72:46,bridge_name='br-int',has_traffic_filtering=True,id=439b29b8-64e3-40fe-b28b-0f8e05155ab6,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap439b29b8-64')
Aug 16 08:14:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waVECumk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:14:35 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[047acd52-b7da-40b5-9c3f-e958ca894ddc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc69284-5895-4f47-afb8-f951e44645d7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:35 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:14:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:35 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:14:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8cc5d23b0>, {}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Disconnecting from: [] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] <== disconnect_volume: return (53ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:14:35 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Deleting instance files /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131_del
Aug 16 08:14:35 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Deletion of /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131_del complete
Aug 16 08:14:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-2e95cc90-a076-4eb7-80ba-5e4832502f8c req-345cc6c8-97f6-4509-8e5f-69864c44956f service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received event network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2e95cc90-a076-4eb7-80ba-5e4832502f8c req-345cc6c8-97f6-4509-8e5f-69864c44956f service nova] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2e95cc90-a076-4eb7-80ba-5e4832502f8c req-345cc6c8-97f6-4509-8e5f-69864c44956f service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2e95cc90-a076-4eb7-80ba-5e4832502f8c req-345cc6c8-97f6-4509-8e5f-69864c44956f service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG nova.compute.manager [req-2e95cc90-a076-4eb7-80ba-5e4832502f8c req-345cc6c8-97f6-4509-8e5f-69864c44956f service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] No waiting events found dispatching network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:14:35 user nova-compute[73091]: WARNING nova.compute.manager [req-2e95cc90-a076-4eb7-80ba-5e4832502f8c req-345cc6c8-97f6-4509-8e5f-69864c44956f service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received unexpected event network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 for instance with vm_state active and task_state rebuilding.
Aug 16 08:14:35 user nova-compute[73091]: INFO nova.virt.block_device [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Booting with volume 10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 at /dev/vdb
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.utils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b981f8-4812-47c9-8b8c-3fa2474f2d1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd3eec5-8ab2-412c-b8c8-1d98665beeab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30ba71c-5b15-428a-85e6-502edbb3b644]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2f6f4b-c416-4005-9135-dd0b43f2df9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:14:35 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:14:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fb5274-d69b-4c48-9caf-fe508e521aa2]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:14:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:14:36 user nova-compute[73091]: DEBUG os_brick.utils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:14:36 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Updating existing volume attachment record: 08db52b8-2edb-4427-9ab0-1e30889e0816 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:14:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Port 1acfd5b5-3ae9-44d0-822d-7382be3fd551 binding to destination host user is already ACTIVE {{(pid=73091) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 08:14:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:14:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquired lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:14:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:14:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-1863526c-b004-4ac9-9c92-20570181657f req-f79998f2-e94c-4942-9299-5bb6be6fe393 service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Received event network-changed-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:14:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-1863526c-b004-4ac9-9c92-20570181657f req-f79998f2-e94c-4942-9299-5bb6be6fe393 service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Refreshing instance network info cache due to event network-changed-fabf307b-a015-44fb-a0d5-f44e2d47b2f1. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:14:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1863526c-b004-4ac9-9c92-20570181657f req-f79998f2-e94c-4942-9299-5bb6be6fe393 service nova] Acquiring lock "refresh_cache-7aded393-c408-48d9-a30c-78b62ce0d09e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:14:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1863526c-b004-4ac9-9c92-20570181657f req-f79998f2-e94c-4942-9299-5bb6be6fe393 service nova] Acquired lock "refresh_cache-7aded393-c408-48d9-a30c-78b62ce0d09e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:14:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-1863526c-b004-4ac9-9c92-20570181657f req-f79998f2-e94c-4942-9299-5bb6be6fe393 service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Refreshing network info cache for port fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-1863526c-b004-4ac9-9c92-20570181657f req-f79998f2-e94c-4942-9299-5bb6be6fe393 service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Updated VIF entry in instance network info cache for port fabf307b-a015-44fb-a0d5-f44e2d47b2f1. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-1863526c-b004-4ac9-9c92-20570181657f req-f79998f2-e94c-4942-9299-5bb6be6fe393 service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Updating instance_info_cache with network_info: [{"id": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "address": "fa:16:3e:87:20:9c", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfabf307b-a0", "ovs_interfaceid": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating instance_info_cache with network_info: [{"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Releasing lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1863526c-b004-4ac9-9c92-20570181657f req-f79998f2-e94c-4942-9299-5bb6be6fe393 service nova] Releasing lock "refresh_cache-7aded393-c408-48d9-a30c-78b62ce0d09e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Creating tmpfile /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/tmpo28byht6 to verify with other compute node that the instance is on the same shared storage. {{(pid=73091) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-0c5a2283-29b6-45fb-a4a5-b894a6b0f5d0 req-770a8742-835c-4bbc-9ca2-aeccc8e9d84b service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-vif-unplugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0c5a2283-29b6-45fb-a4a5-b894a6b0f5d0 req-770a8742-835c-4bbc-9ca2-aeccc8e9d84b service nova] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0c5a2283-29b6-45fb-a4a5-b894a6b0f5d0 req-770a8742-835c-4bbc-9ca2-aeccc8e9d84b service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0c5a2283-29b6-45fb-a4a5-b894a6b0f5d0 req-770a8742-835c-4bbc-9ca2-aeccc8e9d84b service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-0c5a2283-29b6-45fb-a4a5-b894a6b0f5d0 req-770a8742-835c-4bbc-9ca2-aeccc8e9d84b service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] No waiting events found dispatching network-vif-unplugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:14:38 user nova-compute[73091]: WARNING nova.compute.manager [req-0c5a2283-29b6-45fb-a4a5-b894a6b0f5d0 req-770a8742-835c-4bbc-9ca2-aeccc8e9d84b service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received unexpected event network-vif-unplugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 for instance with vm_state resized and task_state resize_reverting.
Aug 16 08:14:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Instance destroyed successfully.
Aug 16 08:14:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lazy-loading 'resources' on Instance uuid 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1087600235',display_name='tempest-ServerActionsTestOtherB-server-1087600235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1087600235',id=5,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYOKpfDgZmCpH8NYnZIDX4Q6r6QSrYp8+9Ju9pcp2BTpCW6+zgtRofh+/Nl5vfXB2jjGRnF27mUoD5eGzz9iJpQmGeAh8YbRVeP6cdUfPheYKUhiI9ogz9BCberiIkZFg==',key_name='tempest-keypair-657367706',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:13:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec0498ad9dc84c56ad076bae8fd158a8',ramdisk_id='',reservation_id='r-wwzf0so4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1828527690',owner_user_name='tempest-ServerActionsTestOtherB-1828527690-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:13:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18882b1744742dbb0b5d157aed696a1',uuid=476de8ea-30dd-4b52-be37-f134e445757f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converting VIF {"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_vif [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1acfd5b5-3a, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:39 user nova-compute[73091]: INFO os_vif [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a')
Aug 16 08:14:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQVAUtDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:14:39 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[486d2a55-34c6-45da-9d4c-d638a3065a31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff0645a-61f6-4279-90ef-868ce662b084]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:39 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:14:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:39 user nova-compute[73091]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:14:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8f069cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20f4a51-15f4-4ceb-95b0-726f294695c1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e234e6-ca3e-482f-925e-e20e7cb8e820]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4536fe83-7d77-4efc-8cc6-81076dbcf872]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0a7023-2fd3-44de-a5c6-3e8b01faccf9]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3215cc65-1321-4ecf-9a35-36c152fabf81]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[05429912-2332-4d1d-951e-ac7d2cdf2e1a]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260]
Aug 16 08:14:39 user nova-compute[73091]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260] successful.
Aug 16 08:14:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d58cd5-e89e-4022-960d-436966c200cf]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] <== disconnect_volume: return (295ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:14:39 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173664.4164398, 6060dcaf-e451-4308-b96f-43bcbf56d621 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:14:39 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] VM Stopped (Lifecycle Event)
Aug 16 08:14:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-bed102aa-9df2-457e-b8c9-927a90d63457 None None] [instance: 6060dcaf-e451-4308-b96f-43bcbf56d621] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:14:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-0d6ace6c-214a-46e4-b904-60ced5bbce97 req-accef0c0-8292-46c5-864e-40592e159ed7 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d6ace6c-214a-46e4-b904-60ced5bbce97 req-accef0c0-8292-46c5-864e-40592e159ed7 service nova] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d6ace6c-214a-46e4-b904-60ced5bbce97 req-accef0c0-8292-46c5-864e-40592e159ed7 service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0d6ace6c-214a-46e4-b904-60ced5bbce97 req-accef0c0-8292-46c5-864e-40592e159ed7 service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-0d6ace6c-214a-46e4-b904-60ced5bbce97 req-accef0c0-8292-46c5-864e-40592e159ed7 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] No waiting events found dispatching network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:14:41 user nova-compute[73091]: WARNING nova.compute.manager [req-0d6ace6c-214a-46e4-b904-60ced5bbce97 req-accef0c0-8292-46c5-864e-40592e159ed7 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received unexpected event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 for instance with vm_state resized and task_state resize_reverting.
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lazy-loading 'migration_context' on Instance uuid 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Refreshing inventories for resource provider a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Updating ProviderTree inventory for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Updating inventory in ProviderTree for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "7aded393-c408-48d9-a30c-78b62ce0d09e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Refreshing aggregate associations for resource provider a5935d1e-4613-4ec5-92d3-58605923e4b9, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lazy-loading 'flavor' on Instance uuid 7aded393-c408-48d9-a30c-78b62ce0d09e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Refreshing trait associations for resource provider a5935d1e-4613-4ec5-92d3-58605923e4b9, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "7aded393-c408-48d9-a30c-78b62ce0d09e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:42 user nova-compute[73091]: INFO nova.compute.manager [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Attaching volume 041d5c22-3852-41f9-985d-bb7e8dca4997 to /dev/vdb
Aug 16 08:14:42 user nova-compute[73091]: DEBUG os_brick.utils [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e52769c-f55f-4c7b-b5f9-e824aafbeda2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[78191619-14c7-4ba0-9f37-96a2de135e82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a79b933-383e-4cfa-9ade-2d0ea3957f52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f781356b-c82f-466d-9c4c-d7b23b8112ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:14:42 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f72ee6-3012-4394-8ec9-431c2b3b6e05]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG os_brick.utils [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Updating existing volume attachment record: 21bd8c26-3eac-496f-a47b-ae034f8cba38 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:14:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.705s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:43 user nova-compute[73091]: INFO nova.compute.manager [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Swapping old allocation on dict_keys(['a5935d1e-4613-4ec5-92d3-58605923e4b9']) held by migration d7d5c217-793b-440c-a654-b060f016d306 for instance
Aug 16 08:14:43 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Overwriting current allocation {'allocations': {'a5935d1e-4613-4ec5-92d3-58605923e4b9': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 20}}, 'project_id': 'ec0498ad9dc84c56ad076bae8fd158a8', 'user_id': 'c18882b1744742dbb0b5d157aed696a1', 'consumer_generation': 1} on consumer 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 16 08:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:14:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquired lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:14:43 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG nova.network.neutron [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating instance_info_cache with network_info: [{"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Releasing lock "refresh_cache-476de8ea-30dd-4b52-be37-f134e445757f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG os_brick.utils [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe79550-1836-48e6-bebf-a10355656ab7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead14ab3-7034-437c-b80a-6a53b581f268]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[07410f4f-4b1b-42fb-b3ab-b94be9c69066]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[38791b00-ce34-46b3-904b-c333f8865638]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:14:44 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:14:44 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[beda7e59-d5b7-4336-acf0-e7573998d735]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG os_brick.utils [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:14:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:14:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Creating image(s)
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "/opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "/opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "/opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.168s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk 1073741824" returned: 0 in 0.049s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Cannot resize image /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Ensure instance console log exists: /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Start _get_guest_xml network_info=[{"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'attachment_id': '08db52b8-2edb-4427-9ab0-1e30889e0816', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waVECumk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '18850651-02ac-459a-838c-b3216bcbe131', 'attached_at': '', 'detached_at': '', 'volume_id': '10ee6294-f727-4e2b-b6ec-3d1e8a1d7881', 'serial': '10ee6294-f727-4e2b-b6ec-3d1e8a1d7881'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:14:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 08:14:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:14:46 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lazy-loading 'vcpu_model' on Instance uuid 18850651-02ac-459a-838c-b3216bcbe131 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waVECumk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:14:47 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:14:47 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:14:47 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[993e6ada-965b-40db-9330-1f3f528780ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:14:47 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d1cfa5-65b0-4caa-b960-09ce4ea7f51a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881] added
Aug 16 08:14:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a33ad9-bda5-40bb-864f-0d5f749a965d]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a434488a-6beb-459c-b940-67d26b636542]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v waVECumk {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v waVECumk" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e83f1cf-7af6-4d79-95d5-dd23790ad55f]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'waVECumk'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[395fdf36-76ab-4988-b4bb-bd36d18aef45]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb752d37-8944-4ae8-b91c-cc9e29dcff65]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6901501-325a-416e-9690-d1d7bdb37362]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260]
Aug 16 08:14:47 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260] successful.
Aug 16 08:14:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[67591358-5a9c-4254-b1e2-914e194b0bb9]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea8d7f7-6c18-40d2-a1b9-0fe09edf0e73]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:47 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:14:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:47 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:14:47 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6a92f8-3dcc-4ee0-9346-d6054f4f77b9]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:14:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waVECumk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23864643037656335', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864643037656335', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T08:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1764805922',display_name='tempest-ServerActionsTestOtherA-server-652148951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1764805922',id=14,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz3j860Gkv1Slc5oyCWy6VoP7hKNPEjEuai3DW0jmBORKbAqdoKcQLb4MoAKfM8zJIG4wm2vu7GJkTGhorCXdn6cmATTCXJNllAcczoCXr4+3AVbBT7pCqZb5Uvu2XtIw==',key_name='tempest-keypair-502085907',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:12:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fc3a302cc78494296980753b56edb0c',ramdisk_id='',reservation_id='r-wmdyi2tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-534432070',owner_user_name='tempest-ServerActionsTestOtherA-534432070-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:14:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5a61e00249d4bc4b14dd0ab5b88e58c',uuid=18850651-02ac-459a-838c-b3216bcbe131,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converting VIF {"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:72:46,bridge_name='br-int',has_traffic_filtering=True,id=439b29b8-64e3-40fe-b28b-0f8e05155ab6,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap439b29b8-64') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:14:48 user nova-compute[73091]:   <uuid>18850651-02ac-459a-838c-b3216bcbe131</uuid>
Aug 16 08:14:48 user nova-compute[73091]:   <name>instance-0000000e</name>
Aug 16 08:14:48 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:14:48 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:14:48 user nova-compute[73091]:   <metadata>
Aug 16 08:14:48 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:14:48 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:14:48 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherA-server-652148951</nova:name>
Aug 16 08:14:48 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:14:46</nova:creationTime>
Aug 16 08:14:48 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:14:48 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:14:48 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:14:48 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:14:48 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:14:48 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:14:48 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:14:48 user nova-compute[73091]:       <nova:owner>
Aug 16 08:14:48 user nova-compute[73091]:         <nova:user uuid="c5a61e00249d4bc4b14dd0ab5b88e58c">tempest-ServerActionsTestOtherA-534432070-project-member</nova:user>
Aug 16 08:14:48 user nova-compute[73091]:         <nova:project uuid="2fc3a302cc78494296980753b56edb0c">tempest-ServerActionsTestOtherA-534432070</nova:project>
Aug 16 08:14:48 user nova-compute[73091]:       </nova:owner>
Aug 16 08:14:48 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:14:48 user nova-compute[73091]:       <nova:ports>
Aug 16 08:14:48 user nova-compute[73091]:         <nova:port uuid="439b29b8-64e3-40fe-b28b-0f8e05155ab6">
Aug 16 08:14:48 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 08:14:48 user nova-compute[73091]:         </nova:port>
Aug 16 08:14:48 user nova-compute[73091]:       </nova:ports>
Aug 16 08:14:48 user nova-compute[73091]:     </nova:instance>
Aug 16 08:14:48 user nova-compute[73091]:   </metadata>
Aug 16 08:14:48 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:14:48 user nova-compute[73091]:     <system>
Aug 16 08:14:48 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:14:48 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:14:48 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:14:48 user nova-compute[73091]:       <entry name="serial">18850651-02ac-459a-838c-b3216bcbe131</entry>
Aug 16 08:14:48 user nova-compute[73091]:       <entry name="uuid">18850651-02ac-459a-838c-b3216bcbe131</entry>
Aug 16 08:14:48 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:14:48 user nova-compute[73091]:     </system>
Aug 16 08:14:48 user nova-compute[73091]:   </sysinfo>
Aug 16 08:14:48 user nova-compute[73091]:   <os>
Aug 16 08:14:48 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:14:48 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:14:48 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:14:48 user nova-compute[73091]:   </os>
Aug 16 08:14:48 user nova-compute[73091]:   <features>
Aug 16 08:14:48 user nova-compute[73091]:     <acpi/>
Aug 16 08:14:48 user nova-compute[73091]:     <apic/>
Aug 16 08:14:48 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:14:48 user nova-compute[73091]:   </features>
Aug 16 08:14:48 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:14:48 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:14:48 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:14:48 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:14:48 user nova-compute[73091]:   </clock>
Aug 16 08:14:48 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:14:48 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:14:48 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:14:48 user nova-compute[73091]:   </cpu>
Aug 16 08:14:48 user nova-compute[73091]:   <devices>
Aug 16 08:14:48 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:14:48 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:14:48 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk"/>
Aug 16 08:14:48 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:14:48 user nova-compute[73091]:     </disk>
Aug 16 08:14:48 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:14:48 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:14:48 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 16 08:14:48 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 08:14:48 user nova-compute[73091]:       <serial>10ee6294-f727-4e2b-b6ec-3d1e8a1d7881</serial>
Aug 16 08:14:48 user nova-compute[73091]:     </disk>
Aug 16 08:14:48 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:14:48 user nova-compute[73091]:       <mac address="fa:16:3e:99:72:46"/>
Aug 16 08:14:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:14:48 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:14:48 user nova-compute[73091]:       <target dev="tap439b29b8-64"/>
Aug 16 08:14:48 user nova-compute[73091]:     </interface>
Aug 16 08:14:48 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:14:48 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/console.log" append="off"/>
Aug 16 08:14:48 user nova-compute[73091]:     </serial>
Aug 16 08:14:48 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:14:48 user nova-compute[73091]:     <video>
Aug 16 08:14:48 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:14:48 user nova-compute[73091]:     </video>
Aug 16 08:14:48 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:14:48 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:14:48 user nova-compute[73091]:     </rng>
Aug 16 08:14:48 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:14:48 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:14:48 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:14:48 user nova-compute[73091]:     </memballoon>
Aug 16 08:14:48 user nova-compute[73091]:   </devices>
Aug 16 08:14:48 user nova-compute[73091]: </domain>
Aug 16 08:14:48 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T08:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1764805922',display_name='tempest-ServerActionsTestOtherA-server-652148951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1764805922',id=14,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz3j860Gkv1Slc5oyCWy6VoP7hKNPEjEuai3DW0jmBORKbAqdoKcQLb4MoAKfM8zJIG4wm2vu7GJkTGhorCXdn6cmATTCXJNllAcczoCXr4+3AVbBT7pCqZb5Uvu2XtIw==',key_name='tempest-keypair-502085907',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:12:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2fc3a302cc78494296980753b56edb0c',ramdisk_id='',reservation_id='r-wmdyi2tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-534432070',owner_user_name='tempest-ServerActionsTestOtherA-534432070-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:14:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5a61e00249d4bc4b14dd0ab5b88e58c',uuid=18850651-02ac-459a-838c-b3216bcbe131,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converting VIF {"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:72:46,bridge_name='br-int',has_traffic_filtering=True,id=439b29b8-64e3-40fe-b28b-0f8e05155ab6,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap439b29b8-64') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG os_vif [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:72:46,bridge_name='br-int',has_traffic_filtering=True,id=439b29b8-64e3-40fe-b28b-0f8e05155ab6,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap439b29b8-64') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap439b29b8-64, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap439b29b8-64, col_values=(('external_ids', {'iface-id': '439b29b8-64e3-40fe-b28b-0f8e05155ab6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:72:46', 'vm-uuid': '18850651-02ac-459a-838c-b3216bcbe131'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:48 user nova-compute[73091]: INFO os_vif [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:72:46,bridge_name='br-int',has_traffic_filtering=True,id=439b29b8-64e3-40fe-b28b-0f8e05155ab6,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap439b29b8-64')
Aug 16 08:14:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:14:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] No VIF found with MAC fa:16:3e:99:72:46, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:14:49 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173674.1654348, 18850651-02ac-459a-838c-b3216bcbe131 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:14:49 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 18850651-02ac-459a-838c-b3216bcbe131] VM Stopped (Lifecycle Event)
Aug 16 08:14:49 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a7b422b2-67f5-43ce-8fb0-a4623edab863 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:14:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-6ea8e253-53ed-46fc-839b-bc27ed95fdd1 req-9cb35761-9499-4673-9b96-b379b3edb9f6 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received event network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:14:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ea8e253-53ed-46fc-839b-bc27ed95fdd1 req-9cb35761-9499-4673-9b96-b379b3edb9f6 service nova] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ea8e253-53ed-46fc-839b-bc27ed95fdd1 req-9cb35761-9499-4673-9b96-b379b3edb9f6 service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ea8e253-53ed-46fc-839b-bc27ed95fdd1 req-9cb35761-9499-4673-9b96-b379b3edb9f6 service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:50 user nova-compute[73091]: DEBUG nova.compute.manager [req-6ea8e253-53ed-46fc-839b-bc27ed95fdd1 req-9cb35761-9499-4673-9b96-b379b3edb9f6 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] No waiting events found dispatching network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:14:50 user nova-compute[73091]: WARNING nova.compute.manager [req-6ea8e253-53ed-46fc-839b-bc27ed95fdd1 req-9cb35761-9499-4673-9b96-b379b3edb9f6 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received unexpected event network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-ccde3d29-390a-4ad1-9936-023094127673 req-cceafda8-cb2b-4835-95b5-1d02ac92b604 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received event network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ccde3d29-390a-4ad1-9936-023094127673 req-cceafda8-cb2b-4835-95b5-1d02ac92b604 service nova] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ccde3d29-390a-4ad1-9936-023094127673 req-cceafda8-cb2b-4835-95b5-1d02ac92b604 service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ccde3d29-390a-4ad1-9936-023094127673 req-cceafda8-cb2b-4835-95b5-1d02ac92b604 service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.compute.manager [req-ccde3d29-390a-4ad1-9936-023094127673 req-cceafda8-cb2b-4835-95b5-1d02ac92b604 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] No waiting events found dispatching network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:14:52 user nova-compute[73091]: WARNING nova.compute.manager [req-ccde3d29-390a-4ad1-9936-023094127673 req-cceafda8-cb2b-4835-95b5-1d02ac92b604 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received unexpected event network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173692.358259, 18850651-02ac-459a-838c-b3216bcbe131 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:14:52 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] VM Resumed (Lifecycle Event)
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:14:52 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Instance spawned successfully.
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:14:52 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173692.3593125, 18850651-02ac-459a-838c-b3216bcbe131 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:14:52 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] VM Started (Lifecycle Event)
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:14:52 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 08:14:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG nova.objects.instance [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73091) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 08:14:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-fbbb0cf4-322a-4b32-9adb-d2111d825500 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:14:53 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:54 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173679.0364094, 476de8ea-30dd-4b52-be37-f134e445757f => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:14:54 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] VM Stopped (Lifecycle Event)
Aug 16 08:14:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8db03482-8600-4e6d-9212-a4c6c8a6a476 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:14:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLuUsFij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:14:58 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:14:58 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:14:58 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d36f04-3910-442b-ae32-2edc1eedacaf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:14:58 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d677f5-783c-4790-ae20-02205a0e3f82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997] added
Aug 16 08:14:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[54559eab-f3cc-43b5-960c-16a98152c67c]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6867b27-e6de-4a48-98c5-973d9eb6003e]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fLuUsFij {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fLuUsFij" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e208e0fe-b19a-4b2f-9e6d-bc7bfb348352]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fLuUsFij'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcbdf33-33ed-428e-962f-2135d3541fca]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1b3e9b-64a2-40e0-843c-45f6cbf8a8da]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:58 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:14:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:58 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:14:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef022c3-c7d9-44b9-ac07-bd642b1656ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997, portal: 172.16.0.220,3260]
Aug 16 08:14:58 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997, portal: 172.16.0.220,3260] successful.
Aug 16 08:14:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf12890-b0cd-4321-b43b-b1e114708770]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9761cc3-1452-4a26-b687-79357d5634d1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:58 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:14:58 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:14:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:14:58 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:14:58 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:14:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88f8170-11ec-476d-961b-2cd3c9617866]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:14:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:14:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:14:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLuUsFij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:14:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:14:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26164386139653731', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:14:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164386139653731', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:14:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lazy-loading 'flavor' on Instance uuid 7aded393-c408-48d9-a30c-78b62ce0d09e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:15:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 08:15:00 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:15:00 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 16 08:15:00 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:15:00 user nova-compute[73091]:   <serial>041d5c22-3852-41f9-985d-bb7e8dca4997</serial>
Aug 16 08:15:00 user nova-compute[73091]: </disk>
Aug 16 08:15:00 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 08:15:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:15:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:15:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] No VIF found with MAC fa:16:3e:87:20:9c, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:15:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4f2ef97b-2a9f-4bbb-942f-a369a8c7d345 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.112s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:15:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:15:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 08:15:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 08:15:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 08:15:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:04 user nova-compute[73091]: INFO nova.compute.manager [None req-ca260c55-8429-4e6a-8834-b1945a633a89 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Unrescuing
Aug 16 08:15:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca260c55-8429-4e6a-8834-b1945a633a89 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:15:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca260c55-8429-4e6a-8834-b1945a633a89 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquired lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:15:04 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ca260c55-8429-4e6a-8834-b1945a633a89 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:15:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "80448987-5965-47bd-ad0b-28cf031f5dea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "80448987-5965-47bd-ad0b-28cf031f5dea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:04 user nova-compute[73091]: DEBUG nova.network.neutron [None req-ca260c55-8429-4e6a-8834-b1945a633a89 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Updating instance_info_cache with network_info: [{"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:15:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-ca260c55-8429-4e6a-8834-b1945a633a89 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Releasing lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:15:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-ca260c55-8429-4e6a-8834-b1945a633a89 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'flavor' on Instance uuid bd541280-cecf-4c1c-bd1f-f7edff830f1e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:15:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:15:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:04 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:15:04 user nova-compute[73091]: INFO nova.compute.claims [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Claim successful on node user
Aug 16 08:15:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-f33db3e8-874a-415e-8e9a-ecd930f23210 req-1c8b99c8-4d8c-4ca4-a16d-85d37d64bab3 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received event network-vif-unplugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f33db3e8-874a-415e-8e9a-ecd930f23210 req-1c8b99c8-4d8c-4ca4-a16d-85d37d64bab3 service nova] Acquiring lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f33db3e8-874a-415e-8e9a-ecd930f23210 req-1c8b99c8-4d8c-4ca4-a16d-85d37d64bab3 service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f33db3e8-874a-415e-8e9a-ecd930f23210 req-1c8b99c8-4d8c-4ca4-a16d-85d37d64bab3 service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-f33db3e8-874a-415e-8e9a-ecd930f23210 req-1c8b99c8-4d8c-4ca4-a16d-85d37d64bab3 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] No waiting events found dispatching network-vif-unplugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:15:05 user nova-compute[73091]: WARNING nova.compute.manager [req-f33db3e8-874a-415e-8e9a-ecd930f23210 req-1c8b99c8-4d8c-4ca4-a16d-85d37d64bab3 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received unexpected event network-vif-unplugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 for instance with vm_state rescued and task_state unrescuing.
Aug 16 08:15:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:15:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:15:05 user nova-compute[73091]: DEBUG nova.policy [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '741b35d305b340bfb00ecffb56a143b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8186c961465c48fc800e3b1ecd4ed077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:15:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Instance destroyed successfully.
Aug 16 08:15:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:15:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Creating image(s)
Aug 16 08:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "/opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "/opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "/opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk 1073741824" returned: 0 in 0.053s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Successfully created port: 998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Cannot resize image /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG nova.objects.instance [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lazy-loading 'migration_context' on Instance uuid 80448987-5965-47bd-ad0b-28cf031f5dea {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Ensure instance console log exists: /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-a0e2ec2d-0d87-4ee1-a38e-a3232ae065cb req-5fde67d3-7b76-4214-aed4-49c7daf32a1a service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a0e2ec2d-0d87-4ee1-a38e-a3232ae065cb req-5fde67d3-7b76-4214-aed4-49c7daf32a1a service nova] Acquiring lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a0e2ec2d-0d87-4ee1-a38e-a3232ae065cb req-5fde67d3-7b76-4214-aed4-49c7daf32a1a service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a0e2ec2d-0d87-4ee1-a38e-a3232ae065cb req-5fde67d3-7b76-4214-aed4-49c7daf32a1a service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-a0e2ec2d-0d87-4ee1-a38e-a3232ae065cb req-5fde67d3-7b76-4214-aed4-49c7daf32a1a service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] No waiting events found dispatching network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:15:07 user nova-compute[73091]: WARNING nova.compute.manager [req-a0e2ec2d-0d87-4ee1-a38e-a3232ae065cb req-5fde67d3-7b76-4214-aed4-49c7daf32a1a service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received unexpected event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 for instance with vm_state rescued and task_state unrescuing.
Aug 16 08:15:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Successfully updated port: 998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "refresh_cache-80448987-5965-47bd-ad0b-28cf031f5dea" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquired lock "refresh_cache-80448987-5965-47bd-ad0b-28cf031f5dea" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b5cf0ee-1628-4653-9bfb-c6a5e4116275 req-78cba8e7-7a84-4bd3-984a-98fc6da24101 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received event network-changed-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-2b5cf0ee-1628-4653-9bfb-c6a5e4116275 req-78cba8e7-7a84-4bd3-984a-98fc6da24101 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Refreshing instance network info cache due to event network-changed-998d8399-d10e-4085-bd9f-c8a1f3022645. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b5cf0ee-1628-4653-9bfb-c6a5e4116275 req-78cba8e7-7a84-4bd3-984a-98fc6da24101 service nova] Acquiring lock "refresh_cache-80448987-5965-47bd-ad0b-28cf031f5dea" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:15:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Updating instance_info_cache with network_info: [{"id": "998d8399-d10e-4085-bd9f-c8a1f3022645", "address": "fa:16:3e:9b:b6:46", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8399-d1", "ovs_interfaceid": "998d8399-d10e-4085-bd9f-c8a1f3022645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Releasing lock "refresh_cache-80448987-5965-47bd-ad0b-28cf031f5dea" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Instance network_info: |[{"id": "998d8399-d10e-4085-bd9f-c8a1f3022645", "address": "fa:16:3e:9b:b6:46", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8399-d1", "ovs_interfaceid": "998d8399-d10e-4085-bd9f-c8a1f3022645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b5cf0ee-1628-4653-9bfb-c6a5e4116275 req-78cba8e7-7a84-4bd3-984a-98fc6da24101 service nova] Acquired lock "refresh_cache-80448987-5965-47bd-ad0b-28cf031f5dea" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-2b5cf0ee-1628-4653-9bfb-c6a5e4116275 req-78cba8e7-7a84-4bd3-984a-98fc6da24101 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Refreshing network info cache for port 998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Start _get_guest_xml network_info=[{"id": "998d8399-d10e-4085-bd9f-c8a1f3022645", "address": "fa:16:3e:9b:b6:46", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8399-d1", "ovs_interfaceid": "998d8399-d10e-4085-bd9f-c8a1f3022645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:15:08 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:15:08 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:15:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-208428893',display_name='tempest-AttachVolumeNegativeTest-server-208428893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-208428893',id=17,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0QHxIwNxCMHkSkW6wLWt5bj1xVj95b2vSTETn8XAzqZuEeoXhpgv2GWpSmE+iaFenFJKwPVQlW6+Hc1kYx/bY3u+79mVNdAMvWpOmq34r1qqWAPE1CPDQbPruEdy2Cyw==',key_name='tempest-keypair-1058417897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8186c961465c48fc800e3b1ecd4ed077',ramdisk_id='',reservation_id='r-f0gu4wi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1216940805',owner_user_name='tempest-AttachVolumeNegativeTest-1216940805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:15:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='741b35d305b340bfb00ecffb56a143b8',uuid=80448987-5965-47bd-ad0b-28cf031f5dea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "998d8399-d10e-4085-bd9f-c8a1f3022645", "address": "fa:16:3e:9b:b6:46", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8399-d1", "ovs_interfaceid": "998d8399-d10e-4085-bd9f-c8a1f3022645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converting VIF {"id": "998d8399-d10e-4085-bd9f-c8a1f3022645", "address": "fa:16:3e:9b:b6:46", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8399-d1", "ovs_interfaceid": "998d8399-d10e-4085-bd9f-c8a1f3022645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b6:46,bridge_name='br-int',has_traffic_filtering=True,id=998d8399-d10e-4085-bd9f-c8a1f3022645,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998d8399-d1') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lazy-loading 'pci_devices' on Instance uuid 80448987-5965-47bd-ad0b-28cf031f5dea {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:15:08 user nova-compute[73091]:   <uuid>80448987-5965-47bd-ad0b-28cf031f5dea</uuid>
Aug 16 08:15:08 user nova-compute[73091]:   <name>instance-00000011</name>
Aug 16 08:15:08 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:15:08 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:15:08 user nova-compute[73091]:   <metadata>
Aug 16 08:15:08 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:15:08 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:15:08 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeNegativeTest-server-208428893</nova:name>
Aug 16 08:15:08 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:15:08</nova:creationTime>
Aug 16 08:15:08 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:15:08 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:15:08 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:15:08 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:15:08 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:15:08 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:15:08 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:15:08 user nova-compute[73091]:       <nova:owner>
Aug 16 08:15:08 user nova-compute[73091]:         <nova:user uuid="741b35d305b340bfb00ecffb56a143b8">tempest-AttachVolumeNegativeTest-1216940805-project-member</nova:user>
Aug 16 08:15:08 user nova-compute[73091]:         <nova:project uuid="8186c961465c48fc800e3b1ecd4ed077">tempest-AttachVolumeNegativeTest-1216940805</nova:project>
Aug 16 08:15:08 user nova-compute[73091]:       </nova:owner>
Aug 16 08:15:08 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:15:08 user nova-compute[73091]:       <nova:ports>
Aug 16 08:15:08 user nova-compute[73091]:         <nova:port uuid="998d8399-d10e-4085-bd9f-c8a1f3022645">
Aug 16 08:15:08 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 08:15:08 user nova-compute[73091]:         </nova:port>
Aug 16 08:15:08 user nova-compute[73091]:       </nova:ports>
Aug 16 08:15:08 user nova-compute[73091]:     </nova:instance>
Aug 16 08:15:08 user nova-compute[73091]:   </metadata>
Aug 16 08:15:08 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:15:08 user nova-compute[73091]:     <system>
Aug 16 08:15:08 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:15:08 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:15:08 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:15:08 user nova-compute[73091]:       <entry name="serial">80448987-5965-47bd-ad0b-28cf031f5dea</entry>
Aug 16 08:15:08 user nova-compute[73091]:       <entry name="uuid">80448987-5965-47bd-ad0b-28cf031f5dea</entry>
Aug 16 08:15:08 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:15:08 user nova-compute[73091]:     </system>
Aug 16 08:15:08 user nova-compute[73091]:   </sysinfo>
Aug 16 08:15:08 user nova-compute[73091]:   <os>
Aug 16 08:15:08 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:15:08 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:15:08 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:15:08 user nova-compute[73091]:   </os>
Aug 16 08:15:08 user nova-compute[73091]:   <features>
Aug 16 08:15:08 user nova-compute[73091]:     <acpi/>
Aug 16 08:15:08 user nova-compute[73091]:     <apic/>
Aug 16 08:15:08 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:15:08 user nova-compute[73091]:   </features>
Aug 16 08:15:08 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:15:08 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:15:08 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:15:08 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:15:08 user nova-compute[73091]:   </clock>
Aug 16 08:15:08 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:15:08 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:15:08 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:15:08 user nova-compute[73091]:   </cpu>
Aug 16 08:15:08 user nova-compute[73091]:   <devices>
Aug 16 08:15:08 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:15:08 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:15:08 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk"/>
Aug 16 08:15:08 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:15:08 user nova-compute[73091]:     </disk>
Aug 16 08:15:08 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:15:08 user nova-compute[73091]:       <mac address="fa:16:3e:9b:b6:46"/>
Aug 16 08:15:08 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:15:08 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:15:08 user nova-compute[73091]:       <target dev="tap998d8399-d1"/>
Aug 16 08:15:08 user nova-compute[73091]:     </interface>
Aug 16 08:15:08 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:15:08 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/console.log" append="off"/>
Aug 16 08:15:08 user nova-compute[73091]:     </serial>
Aug 16 08:15:08 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:15:08 user nova-compute[73091]:     <video>
Aug 16 08:15:08 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:15:08 user nova-compute[73091]:     </video>
Aug 16 08:15:08 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:15:08 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:15:08 user nova-compute[73091]:     </rng>
Aug 16 08:15:08 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:15:08 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:15:08 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:15:08 user nova-compute[73091]:     </memballoon>
Aug 16 08:15:08 user nova-compute[73091]:   </devices>
Aug 16 08:15:08 user nova-compute[73091]: </domain>
Aug 16 08:15:08 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:15:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-208428893',display_name='tempest-AttachVolumeNegativeTest-server-208428893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-208428893',id=17,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0QHxIwNxCMHkSkW6wLWt5bj1xVj95b2vSTETn8XAzqZuEeoXhpgv2GWpSmE+iaFenFJKwPVQlW6+Hc1kYx/bY3u+79mVNdAMvWpOmq34r1qqWAPE1CPDQbPruEdy2Cyw==',key_name='tempest-keypair-1058417897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8186c961465c48fc800e3b1ecd4ed077',ramdisk_id='',reservation_id='r-f0gu4wi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1216940805',owner_user_name='tempest-AttachVolumeNegativeTest-1216940805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:15:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='741b35d305b340bfb00ecffb56a143b8',uuid=80448987-5965-47bd-ad0b-28cf031f5dea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "998d8399-d10e-4085-bd9f-c8a1f3022645", "address": "fa:16:3e:9b:b6:46", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8399-d1", "ovs_interfaceid": "998d8399-d10e-4085-bd9f-c8a1f3022645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converting VIF {"id": "998d8399-d10e-4085-bd9f-c8a1f3022645", "address": "fa:16:3e:9b:b6:46", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8399-d1", "ovs_interfaceid": "998d8399-d10e-4085-bd9f-c8a1f3022645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b6:46,bridge_name='br-int',has_traffic_filtering=True,id=998d8399-d10e-4085-bd9f-c8a1f3022645,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998d8399-d1') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG os_vif [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b6:46,bridge_name='br-int',has_traffic_filtering=True,id=998d8399-d10e-4085-bd9f-c8a1f3022645,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998d8399-d1') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap998d8399-d1, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap998d8399-d1, col_values=(('external_ids', {'iface-id': '998d8399-d10e-4085-bd9f-c8a1f3022645', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:b6:46', 'vm-uuid': '80448987-5965-47bd-ad0b-28cf031f5dea'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:08 user nova-compute[73091]: INFO os_vif [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b6:46,bridge_name='br-int',has_traffic_filtering=True,id=998d8399-d10e-4085-bd9f-c8a1f3022645,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998d8399-d1')
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] No VIF found with MAC fa:16:3e:9b:b6:46, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-2b5cf0ee-1628-4653-9bfb-c6a5e4116275 req-78cba8e7-7a84-4bd3-984a-98fc6da24101 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Updated VIF entry in instance network info cache for port 998d8399-d10e-4085-bd9f-c8a1f3022645. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-2b5cf0ee-1628-4653-9bfb-c6a5e4116275 req-78cba8e7-7a84-4bd3-984a-98fc6da24101 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Updating instance_info_cache with network_info: [{"id": "998d8399-d10e-4085-bd9f-c8a1f3022645", "address": "fa:16:3e:9b:b6:46", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8399-d1", "ovs_interfaceid": "998d8399-d10e-4085-bd9f-c8a1f3022645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:15:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2b5cf0ee-1628-4653-9bfb-c6a5e4116275 req-78cba8e7-7a84-4bd3-984a-98fc6da24101 service nova] Releasing lock "refresh_cache-80448987-5965-47bd-ad0b-28cf031f5dea" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-cff1ff82-b98f-46f9-bb43-b32ae43823b8 req-b89532a3-d6ce-4679-86d3-c2f9dd5cca49 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cff1ff82-b98f-46f9-bb43-b32ae43823b8 req-b89532a3-d6ce-4679-86d3-c2f9dd5cca49 service nova] Acquiring lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cff1ff82-b98f-46f9-bb43-b32ae43823b8 req-b89532a3-d6ce-4679-86d3-c2f9dd5cca49 service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cff1ff82-b98f-46f9-bb43-b32ae43823b8 req-b89532a3-d6ce-4679-86d3-c2f9dd5cca49 service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-cff1ff82-b98f-46f9-bb43-b32ae43823b8 req-b89532a3-d6ce-4679-86d3-c2f9dd5cca49 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] No waiting events found dispatching network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:15:09 user nova-compute[73091]: WARNING nova.compute.manager [req-cff1ff82-b98f-46f9-bb43-b32ae43823b8 req-b89532a3-d6ce-4679-86d3-c2f9dd5cca49 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received unexpected event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 for instance with vm_state rescued and task_state unrescuing.
Aug 16 08:15:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-cff1ff82-b98f-46f9-bb43-b32ae43823b8 req-b89532a3-d6ce-4679-86d3-c2f9dd5cca49 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cff1ff82-b98f-46f9-bb43-b32ae43823b8 req-b89532a3-d6ce-4679-86d3-c2f9dd5cca49 service nova] Acquiring lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cff1ff82-b98f-46f9-bb43-b32ae43823b8 req-b89532a3-d6ce-4679-86d3-c2f9dd5cca49 service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cff1ff82-b98f-46f9-bb43-b32ae43823b8 req-b89532a3-d6ce-4679-86d3-c2f9dd5cca49 service nova] Lock "bd541280-cecf-4c1c-bd1f-f7edff830f1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-cff1ff82-b98f-46f9-bb43-b32ae43823b8 req-b89532a3-d6ce-4679-86d3-c2f9dd5cca49 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] No waiting events found dispatching network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:15:09 user nova-compute[73091]: WARNING nova.compute.manager [req-cff1ff82-b98f-46f9-bb43-b32ae43823b8 req-b89532a3-d6ce-4679-86d3-c2f9dd5cca49 service nova] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Received unexpected event network-vif-plugged-92dd6fb6-f2a1-4af9-be67-6fd7770517e4 for instance with vm_state rescued and task_state unrescuing.
Aug 16 08:15:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Removed pending event for bd541280-cecf-4c1c-bd1f-f7edff830f1e due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173709.5464933, bd541280-cecf-4c1c-bd1f-f7edff830f1e => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:15:09 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] VM Resumed (Lifecycle Event)
Aug 16 08:15:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-ca260c55-8429-4e6a-8834-b1945a633a89 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:15:09 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 08:15:09 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173709.5507898, bd541280-cecf-4c1c-bd1f-f7edff830f1e => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:15:09 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] VM Started (Lifecycle Event)
Aug 16 08:15:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-a2216b5f-0cfd-4b7c-bc2d-7671cbf51e63 req-dd30bafe-1002-40c0-a4bc-5c4135410c12 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received event network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a2216b5f-0cfd-4b7c-bc2d-7671cbf51e63 req-dd30bafe-1002-40c0-a4bc-5c4135410c12 service nova] Acquiring lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a2216b5f-0cfd-4b7c-bc2d-7671cbf51e63 req-dd30bafe-1002-40c0-a4bc-5c4135410c12 service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a2216b5f-0cfd-4b7c-bc2d-7671cbf51e63 req-dd30bafe-1002-40c0-a4bc-5c4135410c12 service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-a2216b5f-0cfd-4b7c-bc2d-7671cbf51e63 req-dd30bafe-1002-40c0-a4bc-5c4135410c12 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] No waiting events found dispatching network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:15:11 user nova-compute[73091]: WARNING nova.compute.manager [req-a2216b5f-0cfd-4b7c-bc2d-7671cbf51e63 req-dd30bafe-1002-40c0-a4bc-5c4135410c12 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received unexpected event network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 for instance with vm_state building and task_state spawning.
Aug 16 08:15:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-a2216b5f-0cfd-4b7c-bc2d-7671cbf51e63 req-dd30bafe-1002-40c0-a4bc-5c4135410c12 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received event network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a2216b5f-0cfd-4b7c-bc2d-7671cbf51e63 req-dd30bafe-1002-40c0-a4bc-5c4135410c12 service nova] Acquiring lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a2216b5f-0cfd-4b7c-bc2d-7671cbf51e63 req-dd30bafe-1002-40c0-a4bc-5c4135410c12 service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:11 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a2216b5f-0cfd-4b7c-bc2d-7671cbf51e63 req-dd30bafe-1002-40c0-a4bc-5c4135410c12 service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:11 user nova-compute[73091]: DEBUG nova.compute.manager [req-a2216b5f-0cfd-4b7c-bc2d-7671cbf51e63 req-dd30bafe-1002-40c0-a4bc-5c4135410c12 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] No waiting events found dispatching network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:15:11 user nova-compute[73091]: WARNING nova.compute.manager [req-a2216b5f-0cfd-4b7c-bc2d-7671cbf51e63 req-dd30bafe-1002-40c0-a4bc-5c4135410c12 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received unexpected event network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 for instance with vm_state building and task_state spawning.
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173712.0177934, 80448987-5965-47bd-ad0b-28cf031f5dea => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:15:12 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] VM Resumed (Lifecycle Event)
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:15:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Instance spawned successfully.
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:15:12 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173712.0201304, 80448987-5965-47bd-ad0b-28cf031f5dea => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:15:12 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] VM Started (Lifecycle Event)
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:15:12 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:15:12 user nova-compute[73091]: INFO nova.compute.manager [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Took 6.48 seconds to spawn the instance on the hypervisor.
Aug 16 08:15:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:15:12 user nova-compute[73091]: INFO nova.compute.manager [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Took 7.92 seconds to build instance.
Aug 16 08:15:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb8ca419-1de6-4daf-9727-a2b7bae0f51c tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "80448987-5965-47bd-ad0b-28cf031f5dea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.038s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:15 user nova-compute[73091]: INFO nova.compute.manager [None req-23cf1551-e5a2-4b3b-930b-630435c3303a tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Unrescuing
Aug 16 08:15:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-23cf1551-e5a2-4b3b-930b-630435c3303a tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:15:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-23cf1551-e5a2-4b3b-930b-630435c3303a tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquired lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:15:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-23cf1551-e5a2-4b3b-930b-630435c3303a tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:15:15 user nova-compute[73091]: DEBUG nova.network.neutron [None req-23cf1551-e5a2-4b3b-930b-630435c3303a tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Updating instance_info_cache with network_info: [{"id": "df5af82e-6121-4551-aea4-adf6897bc4e1", "address": "fa:16:3e:49:79:1a", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5af82e-61", "ovs_interfaceid": "df5af82e-6121-4551-aea4-adf6897bc4e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:15:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-23cf1551-e5a2-4b3b-930b-630435c3303a tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Releasing lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:15:15 user nova-compute[73091]: DEBUG nova.objects.instance [None req-23cf1551-e5a2-4b3b-930b-630435c3303a tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lazy-loading 'flavor' on Instance uuid 4f76c866-84a8-499c-a96c-21a2d65ca3d4 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:15:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-804cb21a-d4e8-472b-9bf1-6fcf3d9f52b5 req-7212c063-81c7-4a72-8309-4ee5a8ec476b service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received event network-vif-unplugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-804cb21a-d4e8-472b-9bf1-6fcf3d9f52b5 req-7212c063-81c7-4a72-8309-4ee5a8ec476b service nova] Acquiring lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-804cb21a-d4e8-472b-9bf1-6fcf3d9f52b5 req-7212c063-81c7-4a72-8309-4ee5a8ec476b service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:16 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-804cb21a-d4e8-472b-9bf1-6fcf3d9f52b5 req-7212c063-81c7-4a72-8309-4ee5a8ec476b service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:16 user nova-compute[73091]: DEBUG nova.compute.manager [req-804cb21a-d4e8-472b-9bf1-6fcf3d9f52b5 req-7212c063-81c7-4a72-8309-4ee5a8ec476b service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] No waiting events found dispatching network-vif-unplugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:15:16 user nova-compute[73091]: WARNING nova.compute.manager [req-804cb21a-d4e8-472b-9bf1-6fcf3d9f52b5 req-7212c063-81c7-4a72-8309-4ee5a8ec476b service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received unexpected event network-vif-unplugged-df5af82e-6121-4551-aea4-adf6897bc4e1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 08:15:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Instance destroyed successfully.
Aug 16 08:15:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-22b66b37-e994-467e-b1d5-487fe806a33c req-b6974fe3-608f-46da-ba37-a46ae87e7241 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-22b66b37-e994-467e-b1d5-487fe806a33c req-b6974fe3-608f-46da-ba37-a46ae87e7241 service nova] Acquiring lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-22b66b37-e994-467e-b1d5-487fe806a33c req-b6974fe3-608f-46da-ba37-a46ae87e7241 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-22b66b37-e994-467e-b1d5-487fe806a33c req-b6974fe3-608f-46da-ba37-a46ae87e7241 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:18 user nova-compute[73091]: DEBUG nova.compute.manager [req-22b66b37-e994-467e-b1d5-487fe806a33c req-b6974fe3-608f-46da-ba37-a46ae87e7241 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] No waiting events found dispatching network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:15:18 user nova-compute[73091]: WARNING nova.compute.manager [req-22b66b37-e994-467e-b1d5-487fe806a33c req-b6974fe3-608f-46da-ba37-a46ae87e7241 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received unexpected event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 08:15:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Starting finish_revert_migration {{(pid=73091) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Start _get_guest_xml network_info=[{"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'attachment_id': '4470935f-d570-4fd7-8068-8bc822a217b2', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQVAUtDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '476de8ea-30dd-4b52-be37-f134e445757f', 'attached_at': '2023-08-16T08:15:20.000000', 'detached_at': '', 'volume_id': '0f37e5a8-0be3-43d7-bff6-390364c5e37c', 'serial': '0f37e5a8-0be3-43d7-bff6-390364c5e37c'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:15:20 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:15:20 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lazy-loading 'vcpu_model' on Instance uuid 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQVAUtDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:15:20 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:15:20 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:15:20 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf61cf4-1a80-4866-9cb4-dc4be3df8fbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:15:20 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd29b049-ec2c-4e6d-84f1-e0c1548ba8fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c] added
Aug 16 08:15:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d4dad5-185d-47e3-be94-080311b45833]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fcc5ae-4251-4efb-8306-7c2136f6c448]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQVAUtDu {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQVAUtDu" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ea9ddb-5cb7-4786-860f-1e2cb7d33ead]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FQVAUtDu'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6984add8-940a-4499-9630-1086335838b9]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32712b7-90fe-4f80-bbdf-5f11a9b19a84]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-89206ef2-f41a-4d6c-af65-225031d50512 req-6898ad3d-d135-4f62-a04f-46ba992945f0 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89206ef2-f41a-4d6c-af65-225031d50512 req-6898ad3d-d135-4f62-a04f-46ba992945f0 service nova] Acquiring lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89206ef2-f41a-4d6c-af65-225031d50512 req-6898ad3d-d135-4f62-a04f-46ba992945f0 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89206ef2-f41a-4d6c-af65-225031d50512 req-6898ad3d-d135-4f62-a04f-46ba992945f0 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-89206ef2-f41a-4d6c-af65-225031d50512 req-6898ad3d-d135-4f62-a04f-46ba992945f0 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] No waiting events found dispatching network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:15:20 user nova-compute[73091]: WARNING nova.compute.manager [req-89206ef2-f41a-4d6c-af65-225031d50512 req-6898ad3d-d135-4f62-a04f-46ba992945f0 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received unexpected event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-89206ef2-f41a-4d6c-af65-225031d50512 req-6898ad3d-d135-4f62-a04f-46ba992945f0 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89206ef2-f41a-4d6c-af65-225031d50512 req-6898ad3d-d135-4f62-a04f-46ba992945f0 service nova] Acquiring lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89206ef2-f41a-4d6c-af65-225031d50512 req-6898ad3d-d135-4f62-a04f-46ba992945f0 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-89206ef2-f41a-4d6c-af65-225031d50512 req-6898ad3d-d135-4f62-a04f-46ba992945f0 service nova] Lock "4f76c866-84a8-499c-a96c-21a2d65ca3d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-89206ef2-f41a-4d6c-af65-225031d50512 req-6898ad3d-d135-4f62-a04f-46ba992945f0 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] No waiting events found dispatching network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:15:20 user nova-compute[73091]: WARNING nova.compute.manager [req-89206ef2-f41a-4d6c-af65-225031d50512 req-6898ad3d-d135-4f62-a04f-46ba992945f0 service nova] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Received unexpected event network-vif-plugged-df5af82e-6121-4551-aea4-adf6897bc4e1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:15:20 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:15:20 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:15:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:15:20 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:15:20 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:15:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d9d326-e4ae-4af2-a0d2-444c027a58c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260]
Aug 16 08:15:20 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260] successful.
Aug 16 08:15:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1914716c-ed99-4179-bb70-6517da2868fd]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[883a5d0b-6ed4-48dc-ba9c-ac6c7c0010c6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:15:20 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:15:20 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:15:20 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:15:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:15:20 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:15:20 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:15:20 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:15:20 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:20 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.029s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e214dc-d174-46ef-aa14-73ef86ab88c0]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQVAUtDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Removed pending event for 4f76c866-84a8-499c-a96c-21a2d65ca3d4 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173721.3368626, 4f76c866-84a8-499c-a96c-21a2d65ca3d4 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:15:21 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] VM Resumed (Lifecycle Event)
Aug 16 08:15:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-23cf1551-e5a2-4b3b-930b-630435c3303a tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173721.3383546, 4f76c866-84a8-499c-a96c-21a2d65ca3d4 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:15:21 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] VM Started (Lifecycle Event)
Aug 16 08:15:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:21 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.539s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] <== connect_volume: return (1545ms) {'type': 'block', 'scsi_wwn': '26435303336653430', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435303336653430', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1087600235',display_name='tempest-ServerActionsTestOtherB-server-1087600235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1087600235',id=5,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYOKpfDgZmCpH8NYnZIDX4Q6r6QSrYp8+9Ju9pcp2BTpCW6+zgtRofh+/Nl5vfXB2jjGRnF27mUoD5eGzz9iJpQmGeAh8YbRVeP6cdUfPheYKUhiI9ogz9BCberiIkZFg==',key_name='tempest-keypair-657367706',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:13:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec0498ad9dc84c56ad076bae8fd158a8',ramdisk_id='',reservation_id='r-wwzf0so4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1828527690',owner_user_name='tempest-ServerActionsTestOtherB-1828527690-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:14:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18882b1744742dbb0b5d157aed696a1',uuid=476de8ea-30dd-4b52-be37-f134e445757f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converting VIF {"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:15:22 user nova-compute[73091]:   <uuid>476de8ea-30dd-4b52-be37-f134e445757f</uuid>
Aug 16 08:15:22 user nova-compute[73091]:   <name>instance-00000005</name>
Aug 16 08:15:22 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:15:22 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:15:22 user nova-compute[73091]:   <metadata>
Aug 16 08:15:22 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:15:22 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:15:22 user nova-compute[73091]:       <nova:name>tempest-ServerActionsTestOtherB-server-1087600235</nova:name>
Aug 16 08:15:22 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:15:20</nova:creationTime>
Aug 16 08:15:22 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:15:22 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:15:22 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:15:22 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:15:22 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:15:22 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:15:22 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:15:22 user nova-compute[73091]:       <nova:owner>
Aug 16 08:15:22 user nova-compute[73091]:         <nova:user uuid="c18882b1744742dbb0b5d157aed696a1">tempest-ServerActionsTestOtherB-1828527690-project-member</nova:user>
Aug 16 08:15:22 user nova-compute[73091]:         <nova:project uuid="ec0498ad9dc84c56ad076bae8fd158a8">tempest-ServerActionsTestOtherB-1828527690</nova:project>
Aug 16 08:15:22 user nova-compute[73091]:       </nova:owner>
Aug 16 08:15:22 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:15:22 user nova-compute[73091]:       <nova:ports>
Aug 16 08:15:22 user nova-compute[73091]:         <nova:port uuid="1acfd5b5-3ae9-44d0-822d-7382be3fd551">
Aug 16 08:15:22 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 08:15:22 user nova-compute[73091]:         </nova:port>
Aug 16 08:15:22 user nova-compute[73091]:       </nova:ports>
Aug 16 08:15:22 user nova-compute[73091]:     </nova:instance>
Aug 16 08:15:22 user nova-compute[73091]:   </metadata>
Aug 16 08:15:22 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:15:22 user nova-compute[73091]:     <system>
Aug 16 08:15:22 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:15:22 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:15:22 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:15:22 user nova-compute[73091]:       <entry name="serial">476de8ea-30dd-4b52-be37-f134e445757f</entry>
Aug 16 08:15:22 user nova-compute[73091]:       <entry name="uuid">476de8ea-30dd-4b52-be37-f134e445757f</entry>
Aug 16 08:15:22 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:15:22 user nova-compute[73091]:     </system>
Aug 16 08:15:22 user nova-compute[73091]:   </sysinfo>
Aug 16 08:15:22 user nova-compute[73091]:   <os>
Aug 16 08:15:22 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:15:22 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:15:22 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:15:22 user nova-compute[73091]:   </os>
Aug 16 08:15:22 user nova-compute[73091]:   <features>
Aug 16 08:15:22 user nova-compute[73091]:     <acpi/>
Aug 16 08:15:22 user nova-compute[73091]:     <apic/>
Aug 16 08:15:22 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:15:22 user nova-compute[73091]:   </features>
Aug 16 08:15:22 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:15:22 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:15:22 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:15:22 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:15:22 user nova-compute[73091]:   </clock>
Aug 16 08:15:22 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:15:22 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:15:22 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:15:22 user nova-compute[73091]:   </cpu>
Aug 16 08:15:22 user nova-compute[73091]:   <devices>
Aug 16 08:15:22 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:15:22 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:15:22 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk"/>
Aug 16 08:15:22 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:15:22 user nova-compute[73091]:     </disk>
Aug 16 08:15:22 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:15:22 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:15:22 user nova-compute[73091]:       <source dev="/dev/sde"/>
Aug 16 08:15:22 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 08:15:22 user nova-compute[73091]:       <serial>0f37e5a8-0be3-43d7-bff6-390364c5e37c</serial>
Aug 16 08:15:22 user nova-compute[73091]:     </disk>
Aug 16 08:15:22 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:15:22 user nova-compute[73091]:       <mac address="fa:16:3e:58:35:e3"/>
Aug 16 08:15:22 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:15:22 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:15:22 user nova-compute[73091]:       <target dev="tap1acfd5b5-3a"/>
Aug 16 08:15:22 user nova-compute[73091]:     </interface>
Aug 16 08:15:22 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:15:22 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/console.log" append="off"/>
Aug 16 08:15:22 user nova-compute[73091]:     </serial>
Aug 16 08:15:22 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:15:22 user nova-compute[73091]:     <video>
Aug 16 08:15:22 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:15:22 user nova-compute[73091]:     </video>
Aug 16 08:15:22 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:15:22 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:15:22 user nova-compute[73091]:     </rng>
Aug 16 08:15:22 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:15:22 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:15:22 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:15:22 user nova-compute[73091]:     </memballoon>
Aug 16 08:15:22 user nova-compute[73091]:   </devices>
Aug 16 08:15:22 user nova-compute[73091]: </domain>
Aug 16 08:15:22 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1087600235',display_name='tempest-ServerActionsTestOtherB-server-1087600235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1087600235',id=5,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYOKpfDgZmCpH8NYnZIDX4Q6r6QSrYp8+9Ju9pcp2BTpCW6+zgtRofh+/Nl5vfXB2jjGRnF27mUoD5eGzz9iJpQmGeAh8YbRVeP6cdUfPheYKUhiI9ogz9BCberiIkZFg==',key_name='tempest-keypair-657367706',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:13:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec0498ad9dc84c56ad076bae8fd158a8',ramdisk_id='',reservation_id='r-wwzf0so4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1828527690',owner_user_name='tempest-ServerActionsTestOtherB-1828527690-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:14:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18882b1744742dbb0b5d157aed696a1',uuid=476de8ea-30dd-4b52-be37-f134e445757f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converting VIF {"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG os_vif [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1acfd5b5-3a, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1acfd5b5-3a, col_values=(('external_ids', {'iface-id': '1acfd5b5-3ae9-44d0-822d-7382be3fd551', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:35:e3', 'vm-uuid': '476de8ea-30dd-4b52-be37-f134e445757f'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:22 user nova-compute[73091]: INFO os_vif [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a')
Aug 16 08:15:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:23 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:15:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-2de59f44-c749-4769-a318-85dd5a6b940a req-96d73925-c1e8-4e9b-a846-d2924f73132b service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Received event network-changed-89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-2de59f44-c749-4769-a318-85dd5a6b940a req-96d73925-c1e8-4e9b-a846-d2924f73132b service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Refreshing instance network info cache due to event network-changed-89db23e2-7d11-40dc-8403-4b0ccbc968de. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2de59f44-c749-4769-a318-85dd5a6b940a req-96d73925-c1e8-4e9b-a846-d2924f73132b service nova] Acquiring lock "refresh_cache-935af9fd-600a-4c48-873b-b39126081748" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2de59f44-c749-4769-a318-85dd5a6b940a req-96d73925-c1e8-4e9b-a846-d2924f73132b service nova] Acquired lock "refresh_cache-935af9fd-600a-4c48-873b-b39126081748" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG nova.network.neutron [req-2de59f44-c749-4769-a318-85dd5a6b940a req-96d73925-c1e8-4e9b-a846-d2924f73132b service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Refreshing network info cache for port 89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.359s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-4647db89-8f94-4b01-848b-711179a82dec req-b1b41f13-b07a-404c-b5a4-ce908a660528 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4647db89-8f94-4b01-848b-711179a82dec req-b1b41f13-b07a-404c-b5a4-ce908a660528 service nova] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4647db89-8f94-4b01-848b-711179a82dec req-b1b41f13-b07a-404c-b5a4-ce908a660528 service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-4647db89-8f94-4b01-848b-711179a82dec req-b1b41f13-b07a-404c-b5a4-ce908a660528 service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG nova.compute.manager [req-4647db89-8f94-4b01-848b-711179a82dec req-b1b41f13-b07a-404c-b5a4-ce908a660528 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] No waiting events found dispatching network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:15:24 user nova-compute[73091]: WARNING nova.compute.manager [req-4647db89-8f94-4b01-848b-711179a82dec req-b1b41f13-b07a-404c-b5a4-ce908a660528 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received unexpected event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 for instance with vm_state resized and task_state resize_reverting.
Aug 16 08:15:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk --force-share --output=json" returned: 0 in 0.349s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:15:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-2de59f44-c749-4769-a318-85dd5a6b940a req-96d73925-c1e8-4e9b-a846-d2924f73132b service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Updated VIF entry in instance network info cache for port 89db23e2-7d11-40dc-8403-4b0ccbc968de. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:15:25 user nova-compute[73091]: DEBUG nova.network.neutron [req-2de59f44-c749-4769-a318-85dd5a6b940a req-96d73925-c1e8-4e9b-a846-d2924f73132b service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Updating instance_info_cache with network_info: [{"id": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "address": "fa:16:3e:33:9d:17", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89db23e2-7d", "ovs_interfaceid": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:15:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2de59f44-c749-4769-a318-85dd5a6b940a req-96d73925-c1e8-4e9b-a846-d2924f73132b service nova] Releasing lock "refresh_cache-935af9fd-600a-4c48-873b-b39126081748" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:15:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:15:27 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173726.929709, 476de8ea-30dd-4b52-be37-f134e445757f => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:15:27 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] VM Resumed (Lifecycle Event)
Aug 16 08:15:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:15:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-dc1a8b02-2979-4ce8-b0bd-94e1143b076b req-5cac1124-bd8a-4abe-95d2-53236c034fb9 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc1a8b02-2979-4ce8-b0bd-94e1143b076b req-5cac1124-bd8a-4abe-95d2-53236c034fb9 service nova] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc1a8b02-2979-4ce8-b0bd-94e1143b076b req-5cac1124-bd8a-4abe-95d2-53236c034fb9 service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dc1a8b02-2979-4ce8-b0bd-94e1143b076b req-5cac1124-bd8a-4abe-95d2-53236c034fb9 service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-dc1a8b02-2979-4ce8-b0bd-94e1143b076b req-5cac1124-bd8a-4abe-95d2-53236c034fb9 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] No waiting events found dispatching network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:15:27 user nova-compute[73091]: WARNING nova.compute.manager [req-dc1a8b02-2979-4ce8-b0bd-94e1143b076b req-5cac1124-bd8a-4abe-95d2-53236c034fb9 service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received unexpected event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 for instance with vm_state resized and task_state resize_reverting.
Aug 16 08:15:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:15:27 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:15:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=7430MB free_disk=25.400283813476562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:15:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:27 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Instance running successfully.
Aug 16 08:15:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] finish_revert_migration finished successfully. {{(pid=73091) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 16 08:15:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:15:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:15:27 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 08:15:27 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173726.9320626, 476de8ea-30dd-4b52-be37-f134e445757f => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:15:27 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] VM Started (Lifecycle Event)
Aug 16 08:15:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:15:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:15:27 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance bd541280-cecf-4c1c-bd1f-f7edff830f1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4a6248b9-f577-4efd-baa2-eb5eb3e47495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance cc7973d9-c703-4345-bf58-ccbe80fd07ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance daf2b789-eba2-419b-99f6-be8f483151ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4f76c866-84a8-499c-a96c-21a2d65ca3d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 18850651-02ac-459a-838c-b3216bcbe131 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 7aded393-c408-48d9-a30c-78b62ce0d09e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 476de8ea-30dd-4b52-be37-f134e445757f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 935af9fd-600a-4c48-873b-b39126081748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 80448987-5965-47bd-ad0b-28cf031f5dea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:15:28 user nova-compute[73091]: INFO nova.compute.manager [None req-b3912df3-efdc-47ad-a1ef-ce8dc0d6b787 tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating instance to original state: 'active'
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:15:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:15:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.888s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "935af9fd-600a-4c48-873b-b39126081748" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "935af9fd-600a-4c48-873b-b39126081748" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lazy-loading 'flavor' on Instance uuid 935af9fd-600a-4c48-873b-b39126081748 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Rebuilding the list of instances to heal {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "935af9fd-600a-4c48-873b-b39126081748" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquired lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG nova.objects.instance [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lazy-loading 'info_cache' on Instance uuid bd541280-cecf-4c1c-bd1f-f7edff830f1e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "935af9fd-600a-4c48-873b-b39126081748" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "935af9fd-600a-4c48-873b-b39126081748" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:30 user nova-compute[73091]: INFO nova.compute.manager [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Attaching volume afe0b9fe-2910-4377-a790-521a2b7c9fb2 to /dev/vdb
Aug 16 08:15:30 user nova-compute[73091]: DEBUG os_brick.utils [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[529fa2b3-2ee3-4622-ba7d-ecf3af04a809]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6977b6-388f-46aa-a562-fbc9fff4fd70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3bda00-0688-40e7-8470-6db5832a503d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fb53c5-d7a5-49c8-b68a-4459668f0171]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:15:31 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:15:31 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d1ab20-b40f-484f-a4f2-fb60f4d53d2a]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG os_brick.utils [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Updating existing volume attachment record: 52689431-bfe9-485f-9e43-ecf50f4799c2 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Updating instance_info_cache with network_info: [{"id": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "address": "fa:16:3e:60:a4:3f", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92dd6fb6-f2", "ovs_interfaceid": "92dd6fb6-f2a1-4af9-be67-6fd7770517e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Releasing lock "refresh_cache-bd541280-cecf-4c1c-bd1f-f7edff830f1e" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: bd541280-cecf-4c1c-bd1f-f7edff830f1e] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:15:31 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:15:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IZpQlNTE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:15:42 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:15:42 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:15:42 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ae87e7-2f77-42ed-abd8-1657b5144e19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:15:42 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[35af7873-edbf-4f65-9c52-4da73f5bab36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2] added
Aug 16 08:15:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8246c3-d32d-4765-95ce-166599815ff8]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ff7738-240c-4db3-9f41-4a2958ddd649]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IZpQlNTE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IZpQlNTE" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5396f344-fbcd-47f9-89e6-2137b2622558]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IZpQlNTE'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eb308d-b11c-4e7f-85fe-39f611579ff7]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a95a10-7554-4e96-aa79-0c1f5841d5ec]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:15:42 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:15:42 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:15:42 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:15:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:15:42 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:15:42 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:15:42 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:15:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd32106-ed8a-4a55-82ee-5ab6e6174025]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2, portal: 172.16.0.220,3260]
Aug 16 08:15:42 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2, portal: 172.16.0.220,3260] successful.
Aug 16 08:15:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dea907-5ad7-4681-b822-1b98a1d9473d]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f675167e-5d8d-403c-90d7-870e3061eb2e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:15:42 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:15:42 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:15:42 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:15:42 user nova-compute[73091]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 (non-flash)
Aug 16 08:15:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:15:42 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:15:42 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:15:42 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:15:42 user nova-compute[73091]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 (non-flash)
Aug 16 08:15:42 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e655295-71d2-47c4-902c-18089278eb32]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:15:42 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IZpQlNTE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:15:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:15:43 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26538346139333238', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:15:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538346139333238', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:15:43 user nova-compute[73091]: DEBUG nova.objects.instance [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lazy-loading 'flavor' on Instance uuid 935af9fd-600a-4c48-873b-b39126081748 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:15:43 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 08:15:43 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:15:43 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 08:15:43 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:15:43 user nova-compute[73091]:   <serial>afe0b9fe-2910-4377-a790-521a2b7c9fb2</serial>
Aug 16 08:15:43 user nova-compute[73091]: </disk>
Aug 16 08:15:43 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 08:15:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:15:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:15:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] No VIF found with MAC fa:16:3e:33:9d:17, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:15:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-b114f571-3153-425b-a6e7-08bc9ecdf626 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "935af9fd-600a-4c48-873b-b39126081748" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.725s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "935af9fd-600a-4c48-873b-b39126081748" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "935af9fd-600a-4c48-873b-b39126081748" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:45 user nova-compute[73091]: INFO nova.compute.manager [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Detaching volume afe0b9fe-2910-4377-a790-521a2b7c9fb2
Aug 16 08:15:45 user nova-compute[73091]: INFO nova.virt.block_device [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Attempting to driver detach volume afe0b9fe-2910-4377-a790-521a2b7c9fb2 from mountpoint /dev/vdb
Aug 16 08:15:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Attempting to detach device vdb from instance 935af9fd-600a-4c48-873b-b39126081748 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 08:15:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:15:45 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:15:45 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 08:15:45 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:15:45 user nova-compute[73091]:   <serial>afe0b9fe-2910-4377-a790-521a2b7c9fb2</serial>
Aug 16 08:15:45 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 08:15:45 user nova-compute[73091]: </disk>
Aug 16 08:15:45 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:15:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Successfully detached device vdb from instance 935af9fd-600a-4c48-873b-b39126081748 from the persistent domain config.
Aug 16 08:15:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 935af9fd-600a-4c48-873b-b39126081748 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 08:15:45 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:15:45 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:15:45 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 08:15:45 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:15:45 user nova-compute[73091]:   <serial>afe0b9fe-2910-4377-a790-521a2b7c9fb2</serial>
Aug 16 08:15:45 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 08:15:45 user nova-compute[73091]: </disk>
Aug 16 08:15:45 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Received event <DeviceRemovedEvent: 1692173746.2227051, 935af9fd-600a-4c48-873b-b39126081748 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 935af9fd-600a-4c48-873b-b39126081748 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 08:15:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Successfully detached device vdb from instance 935af9fd-600a-4c48-873b-b39126081748 from the live domain config.
Aug 16 08:15:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IZpQlNTE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:15:46 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[688ff194-ac44-4e6c-b341-bc044e3a7000]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[080274e1-9fd0-4e59-b969-69d39a1d515c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:15:46 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:15:46 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:15:46 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:15:46 user nova-compute[73091]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 (non-flash)
Aug 16 08:15:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:15:46 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:15:46 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:15:46 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:15:46 user nova-compute[73091]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 (non-flash)
Aug 16 08:15:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8f04e41f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Removing single pathed devices sdf {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde9fe99-4443-4ac2-bf9a-9750c7beebc4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7059a630-5aa9-4028-8ac1-819db5030156]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb18cca8-3e50-4d68-936b-bf6ca84bae71]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.057s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ef1d70-6cad-4229-a91d-09a4fce5a463]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3299f68-a3f1-48b6-91d9-175cdc1093cc]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b25f5d-cb84-43e8-bc31-feb8148489d0]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2, portal: 172.16.0.220,3260]
Aug 16 08:15:46 user nova-compute[73091]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2, portal: 172.16.0.220,3260] successful.
Aug 16 08:15:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afe0b9fe-2910-4377-a790-521a2b7c9fb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc881c01-464e-4c5d-9828-a2d613793822]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] <== disconnect_volume: return (369ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:15:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:15:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lazy-loading 'flavor' on Instance uuid 935af9fd-600a-4c48-873b-b39126081748 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:15:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-70468512-318b-4da2-bb4d-d6da5e9da4d6 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "935af9fd-600a-4c48-873b-b39126081748" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.298s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "6a927702-8a5e-47d8-99de-b049f20b29a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:15:53 user nova-compute[73091]: INFO nova.compute.claims [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Claim successful on node user
Aug 16 08:15:53 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:15:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:15:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:15:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Creating image(s)
Aug 16 08:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "/opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "/opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk 1073741824" returned: 0 in 0.059s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG nova.policy [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '063a618d02174a94a23674a2923acafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bd6561008748148418f8a5a3e3d382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.188s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Cannot resize image /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG nova.objects.instance [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lazy-loading 'migration_context' on Instance uuid 6a927702-8a5e-47d8-99de-b049f20b29a3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Ensure instance console log exists: /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:15:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:15:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Successfully created port: 2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Successfully updated port: 2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "refresh_cache-6a927702-8a5e-47d8-99de-b049f20b29a3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquired lock "refresh_cache-6a927702-8a5e-47d8-99de-b049f20b29a3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-e2aca0ad-01e4-4ce3-98be-058b47b93ba9 req-36b1de4a-8f2a-458a-b919-048f6224d9ef service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Received event network-changed-2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-e2aca0ad-01e4-4ce3-98be-058b47b93ba9 req-36b1de4a-8f2a-458a-b919-048f6224d9ef service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Refreshing instance network info cache due to event network-changed-2334292e-6adb-4800-a26e-26c91045e0f2. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e2aca0ad-01e4-4ce3-98be-058b47b93ba9 req-36b1de4a-8f2a-458a-b919-048f6224d9ef service nova] Acquiring lock "refresh_cache-6a927702-8a5e-47d8-99de-b049f20b29a3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Updating instance_info_cache with network_info: [{"id": "2334292e-6adb-4800-a26e-26c91045e0f2", "address": "fa:16:3e:d1:2f:86", "network": {"id": "ff14bf7f-3994-42a9-8de1-5426de17b16d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bd6561008748148418f8a5a3e3d382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2334292e-6a", "ovs_interfaceid": "2334292e-6adb-4800-a26e-26c91045e0f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Releasing lock "refresh_cache-6a927702-8a5e-47d8-99de-b049f20b29a3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Instance network_info: |[{"id": "2334292e-6adb-4800-a26e-26c91045e0f2", "address": "fa:16:3e:d1:2f:86", "network": {"id": "ff14bf7f-3994-42a9-8de1-5426de17b16d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bd6561008748148418f8a5a3e3d382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2334292e-6a", "ovs_interfaceid": "2334292e-6adb-4800-a26e-26c91045e0f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e2aca0ad-01e4-4ce3-98be-058b47b93ba9 req-36b1de4a-8f2a-458a-b919-048f6224d9ef service nova] Acquired lock "refresh_cache-6a927702-8a5e-47d8-99de-b049f20b29a3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-e2aca0ad-01e4-4ce3-98be-058b47b93ba9 req-36b1de4a-8f2a-458a-b919-048f6224d9ef service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Refreshing network info cache for port 2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Start _get_guest_xml network_info=[{"id": "2334292e-6adb-4800-a26e-26c91045e0f2", "address": "fa:16:3e:d1:2f:86", "network": {"id": "ff14bf7f-3994-42a9-8de1-5426de17b16d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bd6561008748148418f8a5a3e3d382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2334292e-6a", "ovs_interfaceid": "2334292e-6adb-4800-a26e-26c91045e0f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:15:56 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:15:56 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-543309518',display_name='tempest-ServerStableDeviceRescueTest-server-543309518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-543309518',id=18,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRcYmUINnIDd6/hqv1bjm6pDkdjpEUwsMVKGIhxEX8tya/SP3djgUOn12AGt0LfCkaqLq5CNvztIC6i4ovP7l8mpWVmHo9U70ToNSekOgmL8P3jvuTzAOzdG2V7GZE0IQ==',key_name='tempest-keypair-1942242932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bd6561008748148418f8a5a3e3d382',ramdisk_id='',reservation_id='r-9xl9taq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2133277169',owner_user_name='tempest-ServerStableDeviceRescueTest-2133277169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:15:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063a618d02174a94a23674a2923acafb',uuid=6a927702-8a5e-47d8-99de-b049f20b29a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2334292e-6adb-4800-a26e-26c91045e0f2", "address": "fa:16:3e:d1:2f:86", "network": {"id": "ff14bf7f-3994-42a9-8de1-5426de17b16d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bd6561008748148418f8a5a3e3d382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2334292e-6a", "ovs_interfaceid": "2334292e-6adb-4800-a26e-26c91045e0f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Converting VIF {"id": "2334292e-6adb-4800-a26e-26c91045e0f2", "address": "fa:16:3e:d1:2f:86", "network": {"id": "ff14bf7f-3994-42a9-8de1-5426de17b16d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bd6561008748148418f8a5a3e3d382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2334292e-6a", "ovs_interfaceid": "2334292e-6adb-4800-a26e-26c91045e0f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2f:86,bridge_name='br-int',has_traffic_filtering=True,id=2334292e-6adb-4800-a26e-26c91045e0f2,network=Network(ff14bf7f-3994-42a9-8de1-5426de17b16d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2334292e-6a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a927702-8a5e-47d8-99de-b049f20b29a3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:15:56 user nova-compute[73091]:   <uuid>6a927702-8a5e-47d8-99de-b049f20b29a3</uuid>
Aug 16 08:15:56 user nova-compute[73091]:   <name>instance-00000012</name>
Aug 16 08:15:56 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:15:56 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:15:56 user nova-compute[73091]:   <metadata>
Aug 16 08:15:56 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:15:56 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:15:56 user nova-compute[73091]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-543309518</nova:name>
Aug 16 08:15:56 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:15:56</nova:creationTime>
Aug 16 08:15:56 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:15:56 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:15:56 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:15:56 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:15:56 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:15:56 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:15:56 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:15:56 user nova-compute[73091]:       <nova:owner>
Aug 16 08:15:56 user nova-compute[73091]:         <nova:user uuid="063a618d02174a94a23674a2923acafb">tempest-ServerStableDeviceRescueTest-2133277169-project-member</nova:user>
Aug 16 08:15:56 user nova-compute[73091]:         <nova:project uuid="f0bd6561008748148418f8a5a3e3d382">tempest-ServerStableDeviceRescueTest-2133277169</nova:project>
Aug 16 08:15:56 user nova-compute[73091]:       </nova:owner>
Aug 16 08:15:56 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:15:56 user nova-compute[73091]:       <nova:ports>
Aug 16 08:15:56 user nova-compute[73091]:         <nova:port uuid="2334292e-6adb-4800-a26e-26c91045e0f2">
Aug 16 08:15:56 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 08:15:56 user nova-compute[73091]:         </nova:port>
Aug 16 08:15:56 user nova-compute[73091]:       </nova:ports>
Aug 16 08:15:56 user nova-compute[73091]:     </nova:instance>
Aug 16 08:15:56 user nova-compute[73091]:   </metadata>
Aug 16 08:15:56 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:15:56 user nova-compute[73091]:     <system>
Aug 16 08:15:56 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:15:56 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:15:56 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:15:56 user nova-compute[73091]:       <entry name="serial">6a927702-8a5e-47d8-99de-b049f20b29a3</entry>
Aug 16 08:15:56 user nova-compute[73091]:       <entry name="uuid">6a927702-8a5e-47d8-99de-b049f20b29a3</entry>
Aug 16 08:15:56 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:15:56 user nova-compute[73091]:     </system>
Aug 16 08:15:56 user nova-compute[73091]:   </sysinfo>
Aug 16 08:15:56 user nova-compute[73091]:   <os>
Aug 16 08:15:56 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:15:56 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:15:56 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:15:56 user nova-compute[73091]:   </os>
Aug 16 08:15:56 user nova-compute[73091]:   <features>
Aug 16 08:15:56 user nova-compute[73091]:     <acpi/>
Aug 16 08:15:56 user nova-compute[73091]:     <apic/>
Aug 16 08:15:56 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:15:56 user nova-compute[73091]:   </features>
Aug 16 08:15:56 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:15:56 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:15:56 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:15:56 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:15:56 user nova-compute[73091]:   </clock>
Aug 16 08:15:56 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:15:56 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:15:56 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:15:56 user nova-compute[73091]:   </cpu>
Aug 16 08:15:56 user nova-compute[73091]:   <devices>
Aug 16 08:15:56 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:15:56 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:15:56 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk"/>
Aug 16 08:15:56 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:15:56 user nova-compute[73091]:     </disk>
Aug 16 08:15:56 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:15:56 user nova-compute[73091]:       <mac address="fa:16:3e:d1:2f:86"/>
Aug 16 08:15:56 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:15:56 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:15:56 user nova-compute[73091]:       <target dev="tap2334292e-6a"/>
Aug 16 08:15:56 user nova-compute[73091]:     </interface>
Aug 16 08:15:56 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:15:56 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/console.log" append="off"/>
Aug 16 08:15:56 user nova-compute[73091]:     </serial>
Aug 16 08:15:56 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:15:56 user nova-compute[73091]:     <video>
Aug 16 08:15:56 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:15:56 user nova-compute[73091]:     </video>
Aug 16 08:15:56 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:15:56 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:15:56 user nova-compute[73091]:     </rng>
Aug 16 08:15:56 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:15:56 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:15:56 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:15:56 user nova-compute[73091]:     </memballoon>
Aug 16 08:15:56 user nova-compute[73091]:   </devices>
Aug 16 08:15:56 user nova-compute[73091]: </domain>
Aug 16 08:15:56 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-543309518',display_name='tempest-ServerStableDeviceRescueTest-server-543309518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-543309518',id=18,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRcYmUINnIDd6/hqv1bjm6pDkdjpEUwsMVKGIhxEX8tya/SP3djgUOn12AGt0LfCkaqLq5CNvztIC6i4ovP7l8mpWVmHo9U70ToNSekOgmL8P3jvuTzAOzdG2V7GZE0IQ==',key_name='tempest-keypair-1942242932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bd6561008748148418f8a5a3e3d382',ramdisk_id='',reservation_id='r-9xl9taq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2133277169',owner_user_name='tempest-ServerStableDeviceRescueTest-2133277169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:15:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063a618d02174a94a23674a2923acafb',uuid=6a927702-8a5e-47d8-99de-b049f20b29a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2334292e-6adb-4800-a26e-26c91045e0f2", "address": "fa:16:3e:d1:2f:86", "network": {"id": "ff14bf7f-3994-42a9-8de1-5426de17b16d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bd6561008748148418f8a5a3e3d382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2334292e-6a", "ovs_interfaceid": "2334292e-6adb-4800-a26e-26c91045e0f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Converting VIF {"id": "2334292e-6adb-4800-a26e-26c91045e0f2", "address": "fa:16:3e:d1:2f:86", "network": {"id": "ff14bf7f-3994-42a9-8de1-5426de17b16d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bd6561008748148418f8a5a3e3d382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2334292e-6a", "ovs_interfaceid": "2334292e-6adb-4800-a26e-26c91045e0f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2f:86,bridge_name='br-int',has_traffic_filtering=True,id=2334292e-6adb-4800-a26e-26c91045e0f2,network=Network(ff14bf7f-3994-42a9-8de1-5426de17b16d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2334292e-6a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG os_vif [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2f:86,bridge_name='br-int',has_traffic_filtering=True,id=2334292e-6adb-4800-a26e-26c91045e0f2,network=Network(ff14bf7f-3994-42a9-8de1-5426de17b16d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2334292e-6a') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2334292e-6a, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2334292e-6a, col_values=(('external_ids', {'iface-id': '2334292e-6adb-4800-a26e-26c91045e0f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:2f:86', 'vm-uuid': '6a927702-8a5e-47d8-99de-b049f20b29a3'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:56 user nova-compute[73091]: INFO os_vif [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2f:86,bridge_name='br-int',has_traffic_filtering=True,id=2334292e-6adb-4800-a26e-26c91045e0f2,network=Network(ff14bf7f-3994-42a9-8de1-5426de17b16d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2334292e-6a')
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:15:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] No VIF found with MAC fa:16:3e:d1:2f:86, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:15:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-e2aca0ad-01e4-4ce3-98be-058b47b93ba9 req-36b1de4a-8f2a-458a-b919-048f6224d9ef service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Updated VIF entry in instance network info cache for port 2334292e-6adb-4800-a26e-26c91045e0f2. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:15:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-e2aca0ad-01e4-4ce3-98be-058b47b93ba9 req-36b1de4a-8f2a-458a-b919-048f6224d9ef service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Updating instance_info_cache with network_info: [{"id": "2334292e-6adb-4800-a26e-26c91045e0f2", "address": "fa:16:3e:d1:2f:86", "network": {"id": "ff14bf7f-3994-42a9-8de1-5426de17b16d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bd6561008748148418f8a5a3e3d382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2334292e-6a", "ovs_interfaceid": "2334292e-6adb-4800-a26e-26c91045e0f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:15:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e2aca0ad-01e4-4ce3-98be-058b47b93ba9 req-36b1de4a-8f2a-458a-b919-048f6224d9ef service nova] Releasing lock "refresh_cache-6a927702-8a5e-47d8-99de-b049f20b29a3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:15:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:15:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173760.7539487, 6a927702-8a5e-47d8-99de-b049f20b29a3 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:16:00 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] VM Resumed (Lifecycle Event)
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:16:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Instance spawned successfully.
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-d2445c59-f209-4bc2-a766-e339fd4d718f req-33c2c362-e76c-4951-aeba-bd44dd5cee32 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Received event network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d2445c59-f209-4bc2-a766-e339fd4d718f req-33c2c362-e76c-4951-aeba-bd44dd5cee32 service nova] Acquiring lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d2445c59-f209-4bc2-a766-e339fd4d718f req-33c2c362-e76c-4951-aeba-bd44dd5cee32 service nova] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-d2445c59-f209-4bc2-a766-e339fd4d718f req-33c2c362-e76c-4951-aeba-bd44dd5cee32 service nova] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-d2445c59-f209-4bc2-a766-e339fd4d718f req-33c2c362-e76c-4951-aeba-bd44dd5cee32 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] No waiting events found dispatching network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:16:00 user nova-compute[73091]: WARNING nova.compute.manager [req-d2445c59-f209-4bc2-a766-e339fd4d718f req-33c2c362-e76c-4951-aeba-bd44dd5cee32 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Received unexpected event network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 for instance with vm_state building and task_state spawning.
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:16:00 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173760.755895, 6a927702-8a5e-47d8-99de-b049f20b29a3 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:16:00 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] VM Started (Lifecycle Event)
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:16:00 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:16:00 user nova-compute[73091]: INFO nova.compute.manager [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Took 7.05 seconds to spawn the instance on the hypervisor.
Aug 16 08:16:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:16:01 user nova-compute[73091]: INFO nova.compute.manager [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Took 7.96 seconds to build instance.
Aug 16 08:16:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-55233d55-b3da-4324-9220-0e7a0be248fe tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.081s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-a6ee3ce8-379a-442c-a644-4474e3cf109b req-d9be15a0-a3c1-4680-9cb8-a4c4fc96fe62 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Received event network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a6ee3ce8-379a-442c-a644-4474e3cf109b req-d9be15a0-a3c1-4680-9cb8-a4c4fc96fe62 service nova] Acquiring lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a6ee3ce8-379a-442c-a644-4474e3cf109b req-d9be15a0-a3c1-4680-9cb8-a4c4fc96fe62 service nova] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a6ee3ce8-379a-442c-a644-4474e3cf109b req-d9be15a0-a3c1-4680-9cb8-a4c4fc96fe62 service nova] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:02 user nova-compute[73091]: DEBUG nova.compute.manager [req-a6ee3ce8-379a-442c-a644-4474e3cf109b req-d9be15a0-a3c1-4680-9cb8-a4c4fc96fe62 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] No waiting events found dispatching network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:16:02 user nova-compute[73091]: WARNING nova.compute.manager [req-a6ee3ce8-379a-442c-a644-4474e3cf109b req-d9be15a0-a3c1-4680-9cb8-a4c4fc96fe62 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Received unexpected event network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 for instance with vm_state active and task_state None.
Aug 16 08:16:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:16:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:16:05 user nova-compute[73091]: INFO nova.compute.claims [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Claim successful on node user
Aug 16 08:16:05 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:16:05 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:16:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:16:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:16:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:16:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:16:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:16:05 user nova-compute[73091]: DEBUG nova.policy [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87f8776bf61340fd924e1a710c07bf06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262cfe8cedea4c91884fab18e18bc828', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:16:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:16:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:16:05 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Creating image(s)
Aug 16 08:16:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "/opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "/opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "/opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:05 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.221s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.209s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk 1073741824" returned: 0 in 0.065s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.211s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Cannot resize image /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG nova.objects.instance [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lazy-loading 'migration_context' on Instance uuid a79098c3-784e-4315-8fd0-0ff883d4f6e3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Ensure instance console log exists: /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Successfully created port: 201fb9b8-9e2e-4088-8090-7840abedfdee {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:16:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Successfully updated port: 201fb9b8-9e2e-4088-8090-7840abedfdee {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "refresh_cache-a79098c3-784e-4315-8fd0-0ff883d4f6e3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquired lock "refresh_cache-a79098c3-784e-4315-8fd0-0ff883d4f6e3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-1d1d7857-3e3c-4503-9b84-dae11d452524 req-f9b33164-6448-42d5-9c21-920746b09ca8 service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Received event network-changed-201fb9b8-9e2e-4088-8090-7840abedfdee {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-1d1d7857-3e3c-4503-9b84-dae11d452524 req-f9b33164-6448-42d5-9c21-920746b09ca8 service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Refreshing instance network info cache due to event network-changed-201fb9b8-9e2e-4088-8090-7840abedfdee. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1d1d7857-3e3c-4503-9b84-dae11d452524 req-f9b33164-6448-42d5-9c21-920746b09ca8 service nova] Acquiring lock "refresh_cache-a79098c3-784e-4315-8fd0-0ff883d4f6e3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Updating instance_info_cache with network_info: [{"id": "201fb9b8-9e2e-4088-8090-7840abedfdee", "address": "fa:16:3e:bb:cf:90", "network": {"id": "1b4f840a-4ae4-4ec6-b69f-c6dcc5a07615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-590024824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262cfe8cedea4c91884fab18e18bc828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201fb9b8-9e", "ovs_interfaceid": "201fb9b8-9e2e-4088-8090-7840abedfdee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Releasing lock "refresh_cache-a79098c3-784e-4315-8fd0-0ff883d4f6e3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Instance network_info: |[{"id": "201fb9b8-9e2e-4088-8090-7840abedfdee", "address": "fa:16:3e:bb:cf:90", "network": {"id": "1b4f840a-4ae4-4ec6-b69f-c6dcc5a07615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-590024824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262cfe8cedea4c91884fab18e18bc828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201fb9b8-9e", "ovs_interfaceid": "201fb9b8-9e2e-4088-8090-7840abedfdee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1d1d7857-3e3c-4503-9b84-dae11d452524 req-f9b33164-6448-42d5-9c21-920746b09ca8 service nova] Acquired lock "refresh_cache-a79098c3-784e-4315-8fd0-0ff883d4f6e3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-1d1d7857-3e3c-4503-9b84-dae11d452524 req-f9b33164-6448-42d5-9c21-920746b09ca8 service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Refreshing network info cache for port 201fb9b8-9e2e-4088-8090-7840abedfdee {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Start _get_guest_xml network_info=[{"id": "201fb9b8-9e2e-4088-8090-7840abedfdee", "address": "fa:16:3e:bb:cf:90", "network": {"id": "1b4f840a-4ae4-4ec6-b69f-c6dcc5a07615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-590024824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262cfe8cedea4c91884fab18e18bc828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201fb9b8-9e", "ovs_interfaceid": "201fb9b8-9e2e-4088-8090-7840abedfdee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:16:08 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:16:08 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1301147426',display_name='tempest-TestServerVolumeAttachmentScenario-server-1301147426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1301147426',id=19,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+M093Xt2MAIymt+b5Y5NG+3+cLbSGrR1uyjKn90bfA5PPLAMNMwJwbx4GrvxoGvUb3Zgj1w036dK/lMQbCmktP6XvOiHtFHT/FuQ/6+9pRBpMNic7mgUm+1OgLR7dmmQ==',key_name='tempest-keypair-1442204226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='262cfe8cedea4c91884fab18e18bc828',ramdisk_id='',reservation_id='r-oyngpt2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-532805896',owner_user_name='tempest-TestServerVolumeAttachmentScenario-532805896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:16:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87f8776bf61340fd924e1a710c07bf06',uuid=a79098c3-784e-4315-8fd0-0ff883d4f6e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201fb9b8-9e2e-4088-8090-7840abedfdee", "address": "fa:16:3e:bb:cf:90", "network": {"id": "1b4f840a-4ae4-4ec6-b69f-c6dcc5a07615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-590024824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262cfe8cedea4c91884fab18e18bc828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201fb9b8-9e", "ovs_interfaceid": "201fb9b8-9e2e-4088-8090-7840abedfdee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Converting VIF {"id": "201fb9b8-9e2e-4088-8090-7840abedfdee", "address": "fa:16:3e:bb:cf:90", "network": {"id": "1b4f840a-4ae4-4ec6-b69f-c6dcc5a07615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-590024824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262cfe8cedea4c91884fab18e18bc828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201fb9b8-9e", "ovs_interfaceid": "201fb9b8-9e2e-4088-8090-7840abedfdee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:cf:90,bridge_name='br-int',has_traffic_filtering=True,id=201fb9b8-9e2e-4088-8090-7840abedfdee,network=Network(1b4f840a-4ae4-4ec6-b69f-c6dcc5a07615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201fb9b8-9e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lazy-loading 'pci_devices' on Instance uuid a79098c3-784e-4315-8fd0-0ff883d4f6e3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:16:08 user nova-compute[73091]:   <uuid>a79098c3-784e-4315-8fd0-0ff883d4f6e3</uuid>
Aug 16 08:16:08 user nova-compute[73091]:   <name>instance-00000013</name>
Aug 16 08:16:08 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:16:08 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:16:08 user nova-compute[73091]:   <metadata>
Aug 16 08:16:08 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:16:08 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:16:08 user nova-compute[73091]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1301147426</nova:name>
Aug 16 08:16:08 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:16:08</nova:creationTime>
Aug 16 08:16:08 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:16:08 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:16:08 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:16:08 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:16:08 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:16:08 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:16:08 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:16:08 user nova-compute[73091]:       <nova:owner>
Aug 16 08:16:08 user nova-compute[73091]:         <nova:user uuid="87f8776bf61340fd924e1a710c07bf06">tempest-TestServerVolumeAttachmentScenario-532805896-project-member</nova:user>
Aug 16 08:16:08 user nova-compute[73091]:         <nova:project uuid="262cfe8cedea4c91884fab18e18bc828">tempest-TestServerVolumeAttachmentScenario-532805896</nova:project>
Aug 16 08:16:08 user nova-compute[73091]:       </nova:owner>
Aug 16 08:16:08 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:16:08 user nova-compute[73091]:       <nova:ports>
Aug 16 08:16:08 user nova-compute[73091]:         <nova:port uuid="201fb9b8-9e2e-4088-8090-7840abedfdee">
Aug 16 08:16:08 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 08:16:08 user nova-compute[73091]:         </nova:port>
Aug 16 08:16:08 user nova-compute[73091]:       </nova:ports>
Aug 16 08:16:08 user nova-compute[73091]:     </nova:instance>
Aug 16 08:16:08 user nova-compute[73091]:   </metadata>
Aug 16 08:16:08 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:16:08 user nova-compute[73091]:     <system>
Aug 16 08:16:08 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:16:08 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:16:08 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:16:08 user nova-compute[73091]:       <entry name="serial">a79098c3-784e-4315-8fd0-0ff883d4f6e3</entry>
Aug 16 08:16:08 user nova-compute[73091]:       <entry name="uuid">a79098c3-784e-4315-8fd0-0ff883d4f6e3</entry>
Aug 16 08:16:08 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:16:08 user nova-compute[73091]:     </system>
Aug 16 08:16:08 user nova-compute[73091]:   </sysinfo>
Aug 16 08:16:08 user nova-compute[73091]:   <os>
Aug 16 08:16:08 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:16:08 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:16:08 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:16:08 user nova-compute[73091]:   </os>
Aug 16 08:16:08 user nova-compute[73091]:   <features>
Aug 16 08:16:08 user nova-compute[73091]:     <acpi/>
Aug 16 08:16:08 user nova-compute[73091]:     <apic/>
Aug 16 08:16:08 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:16:08 user nova-compute[73091]:   </features>
Aug 16 08:16:08 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:16:08 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:16:08 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:16:08 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:16:08 user nova-compute[73091]:   </clock>
Aug 16 08:16:08 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:16:08 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:16:08 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:16:08 user nova-compute[73091]:   </cpu>
Aug 16 08:16:08 user nova-compute[73091]:   <devices>
Aug 16 08:16:08 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:16:08 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:16:08 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk"/>
Aug 16 08:16:08 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:16:08 user nova-compute[73091]:     </disk>
Aug 16 08:16:08 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:16:08 user nova-compute[73091]:       <mac address="fa:16:3e:bb:cf:90"/>
Aug 16 08:16:08 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:16:08 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:16:08 user nova-compute[73091]:       <target dev="tap201fb9b8-9e"/>
Aug 16 08:16:08 user nova-compute[73091]:     </interface>
Aug 16 08:16:08 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:16:08 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/console.log" append="off"/>
Aug 16 08:16:08 user nova-compute[73091]:     </serial>
Aug 16 08:16:08 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:16:08 user nova-compute[73091]:     <video>
Aug 16 08:16:08 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:16:08 user nova-compute[73091]:     </video>
Aug 16 08:16:08 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:16:08 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:16:08 user nova-compute[73091]:     </rng>
Aug 16 08:16:08 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:16:08 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:16:08 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:16:08 user nova-compute[73091]:     </memballoon>
Aug 16 08:16:08 user nova-compute[73091]:   </devices>
Aug 16 08:16:08 user nova-compute[73091]: </domain>
Aug 16 08:16:08 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1301147426',display_name='tempest-TestServerVolumeAttachmentScenario-server-1301147426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1301147426',id=19,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+M093Xt2MAIymt+b5Y5NG+3+cLbSGrR1uyjKn90bfA5PPLAMNMwJwbx4GrvxoGvUb3Zgj1w036dK/lMQbCmktP6XvOiHtFHT/FuQ/6+9pRBpMNic7mgUm+1OgLR7dmmQ==',key_name='tempest-keypair-1442204226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='262cfe8cedea4c91884fab18e18bc828',ramdisk_id='',reservation_id='r-oyngpt2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-532805896',owner_user_name='tempest-TestServerVolumeAttachmentScenario-532805896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:16:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87f8776bf61340fd924e1a710c07bf06',uuid=a79098c3-784e-4315-8fd0-0ff883d4f6e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201fb9b8-9e2e-4088-8090-7840abedfdee", "address": "fa:16:3e:bb:cf:90", "network": {"id": "1b4f840a-4ae4-4ec6-b69f-c6dcc5a07615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-590024824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262cfe8cedea4c91884fab18e18bc828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201fb9b8-9e", "ovs_interfaceid": "201fb9b8-9e2e-4088-8090-7840abedfdee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Converting VIF {"id": "201fb9b8-9e2e-4088-8090-7840abedfdee", "address": "fa:16:3e:bb:cf:90", "network": {"id": "1b4f840a-4ae4-4ec6-b69f-c6dcc5a07615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-590024824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262cfe8cedea4c91884fab18e18bc828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201fb9b8-9e", "ovs_interfaceid": "201fb9b8-9e2e-4088-8090-7840abedfdee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:cf:90,bridge_name='br-int',has_traffic_filtering=True,id=201fb9b8-9e2e-4088-8090-7840abedfdee,network=Network(1b4f840a-4ae4-4ec6-b69f-c6dcc5a07615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201fb9b8-9e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG os_vif [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:cf:90,bridge_name='br-int',has_traffic_filtering=True,id=201fb9b8-9e2e-4088-8090-7840abedfdee,network=Network(1b4f840a-4ae4-4ec6-b69f-c6dcc5a07615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201fb9b8-9e') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap201fb9b8-9e, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap201fb9b8-9e, col_values=(('external_ids', {'iface-id': '201fb9b8-9e2e-4088-8090-7840abedfdee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:cf:90', 'vm-uuid': 'a79098c3-784e-4315-8fd0-0ff883d4f6e3'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:08 user nova-compute[73091]: INFO os_vif [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:cf:90,bridge_name='br-int',has_traffic_filtering=True,id=201fb9b8-9e2e-4088-8090-7840abedfdee,network=Network(1b4f840a-4ae4-4ec6-b69f-c6dcc5a07615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201fb9b8-9e')
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] No VIF found with MAC fa:16:3e:bb:cf:90, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-1d1d7857-3e3c-4503-9b84-dae11d452524 req-f9b33164-6448-42d5-9c21-920746b09ca8 service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Updated VIF entry in instance network info cache for port 201fb9b8-9e2e-4088-8090-7840abedfdee. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:16:08 user nova-compute[73091]: DEBUG nova.network.neutron [req-1d1d7857-3e3c-4503-9b84-dae11d452524 req-f9b33164-6448-42d5-9c21-920746b09ca8 service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Updating instance_info_cache with network_info: [{"id": "201fb9b8-9e2e-4088-8090-7840abedfdee", "address": "fa:16:3e:bb:cf:90", "network": {"id": "1b4f840a-4ae4-4ec6-b69f-c6dcc5a07615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-590024824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262cfe8cedea4c91884fab18e18bc828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201fb9b8-9e", "ovs_interfaceid": "201fb9b8-9e2e-4088-8090-7840abedfdee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:16:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1d1d7857-3e3c-4503-9b84-dae11d452524 req-f9b33164-6448-42d5-9c21-920746b09ca8 service nova] Releasing lock "refresh_cache-a79098c3-784e-4315-8fd0-0ff883d4f6e3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:16:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-9268f860-d52c-41f5-83ce-bd8a9583e096 req-e709f9a7-56e5-4305-a663-4cee2c685fce service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Received event network-vif-plugged-201fb9b8-9e2e-4088-8090-7840abedfdee {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9268f860-d52c-41f5-83ce-bd8a9583e096 req-e709f9a7-56e5-4305-a663-4cee2c685fce service nova] Acquiring lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9268f860-d52c-41f5-83ce-bd8a9583e096 req-e709f9a7-56e5-4305-a663-4cee2c685fce service nova] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-9268f860-d52c-41f5-83ce-bd8a9583e096 req-e709f9a7-56e5-4305-a663-4cee2c685fce service nova] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-9268f860-d52c-41f5-83ce-bd8a9583e096 req-e709f9a7-56e5-4305-a663-4cee2c685fce service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] No waiting events found dispatching network-vif-plugged-201fb9b8-9e2e-4088-8090-7840abedfdee {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:16:10 user nova-compute[73091]: WARNING nova.compute.manager [req-9268f860-d52c-41f5-83ce-bd8a9583e096 req-e709f9a7-56e5-4305-a663-4cee2c685fce service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Received unexpected event network-vif-plugged-201fb9b8-9e2e-4088-8090-7840abedfdee for instance with vm_state building and task_state spawning.
Aug 16 08:16:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc6d5d13-17e8-4900-9cdd-56aaf2254a9c req-df0dc5e7-9dca-425d-8b0b-8a90b4378952 service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Received event network-vif-plugged-201fb9b8-9e2e-4088-8090-7840abedfdee {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc6d5d13-17e8-4900-9cdd-56aaf2254a9c req-df0dc5e7-9dca-425d-8b0b-8a90b4378952 service nova] Acquiring lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc6d5d13-17e8-4900-9cdd-56aaf2254a9c req-df0dc5e7-9dca-425d-8b0b-8a90b4378952 service nova] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cc6d5d13-17e8-4900-9cdd-56aaf2254a9c req-df0dc5e7-9dca-425d-8b0b-8a90b4378952 service nova] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-cc6d5d13-17e8-4900-9cdd-56aaf2254a9c req-df0dc5e7-9dca-425d-8b0b-8a90b4378952 service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] No waiting events found dispatching network-vif-plugged-201fb9b8-9e2e-4088-8090-7840abedfdee {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:16:12 user nova-compute[73091]: WARNING nova.compute.manager [req-cc6d5d13-17e8-4900-9cdd-56aaf2254a9c req-df0dc5e7-9dca-425d-8b0b-8a90b4378952 service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Received unexpected event network-vif-plugged-201fb9b8-9e2e-4088-8090-7840abedfdee for instance with vm_state building and task_state spawning.
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173772.7322633, a79098c3-784e-4315-8fd0-0ff883d4f6e3 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:16:12 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] VM Resumed (Lifecycle Event)
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:16:12 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Instance spawned successfully.
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:12 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173772.7345243, a79098c3-784e-4315-8fd0-0ff883d4f6e3 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:16:12 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] VM Started (Lifecycle Event)
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:16:12 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:16:12 user nova-compute[73091]: INFO nova.compute.manager [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Took 7.00 seconds to spawn the instance on the hypervisor.
Aug 16 08:16:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:16:13 user nova-compute[73091]: INFO nova.compute.manager [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Took 8.04 seconds to build instance.
Aug 16 08:16:13 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-aad8033c-6ca0-49a9-b294-f089e173329a tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.174s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:22 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:16:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:22 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:16:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:23 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:23 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:24 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:16:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:16:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:16:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:27 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:28 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:16:28 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=7032MB free_disk=25.34152603149414GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance bd541280-cecf-4c1c-bd1f-f7edff830f1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4a6248b9-f577-4efd-baa2-eb5eb3e47495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance cc7973d9-c703-4345-bf58-ccbe80fd07ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance daf2b789-eba2-419b-99f6-be8f483151ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4f76c866-84a8-499c-a96c-21a2d65ca3d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 18850651-02ac-459a-838c-b3216bcbe131 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 7aded393-c408-48d9-a30c-78b62ce0d09e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 476de8ea-30dd-4b52-be37-f134e445757f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 935af9fd-600a-4c48-873b-b39126081748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 80448987-5965-47bd-ad0b-28cf031f5dea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 6a927702-8a5e-47d8-99de-b049f20b29a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance a79098c3-784e-4315-8fd0-0ff883d4f6e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:16:28 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:16:29 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:16:29 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:16:29 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:16:29 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquired lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Updating instance_info_cache with network_info: [{"id": "e00351b1-2886-496b-9a27-606de620f78d", "address": "fa:16:3e:13:43:df", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape00351b1-28", "ovs_interfaceid": "e00351b1-2886-496b-9a27-606de620f78d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Releasing lock "refresh_cache-4a6248b9-f577-4efd-baa2-eb5eb3e47495" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 4a6248b9-f577-4efd-baa2-eb5eb3e47495] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:16:30 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:16:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:16:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Acquiring lock "b989d006-e422-41eb-94f4-69667f2c26fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "b989d006-e422-41eb-94f4-69667f2c26fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:16:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:34 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:16:34 user nova-compute[73091]: INFO nova.compute.claims [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Claim successful on node user
Aug 16 08:16:35 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:16:35 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:16:35 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:16:35 user nova-compute[73091]: INFO nova.virt.block_device [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Booting with volume a81fcd58-6d6c-4192-abcc-e8a0f4a48992 at /dev/vda
Aug 16 08:16:35 user nova-compute[73091]: DEBUG nova.policy [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24b833578e0341aab439f8a2f611d3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48441e65eff8478f9a562b9cec17af11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG os_brick.utils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87b455b-243f-49b6-bebf-ca6e251bb343]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fecd17-f17a-496c-9e08-35eb933112b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba2eb9c-c576-4bd9-a524-4b4f93b701cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[facee556-0aad-4daa-a99f-30d1a60f3ea1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:16:35 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:16:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e35bb5f-37b8-4c63-8fd5-1ed547e41d7c]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG os_brick.utils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:16:35 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Updating existing volume attachment record: 1a3b1362-502a-4762-92b2-9790b9ce45f7 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:16:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Successfully created port: f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:16:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "4db26226-32ce-458d-ab6c-8019ae0032fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "4db26226-32ce-458d-ab6c-8019ae0032fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:37 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:16:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:37 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:16:37 user nova-compute[73091]: INFO nova.compute.claims [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Claim successful on node user
Aug 16 08:16:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Successfully updated port: f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:16:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Acquiring lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:16:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Acquired lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:16:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:16:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-1725386b-d2a8-42bf-91b2-e41b16436f07 req-462e6e45-9fc7-402c-8290-237a24bb347f service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Received event network-changed-f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:37 user nova-compute[73091]: DEBUG nova.compute.manager [req-1725386b-d2a8-42bf-91b2-e41b16436f07 req-462e6e45-9fc7-402c-8290-237a24bb347f service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Refreshing instance network info cache due to event network-changed-f9eb011a-7d5c-4be9-b942-892f3bd8da61. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:16:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1725386b-d2a8-42bf-91b2-e41b16436f07 req-462e6e45-9fc7-402c-8290-237a24bb347f service nova] Acquiring lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:16:37 user nova-compute[73091]: DEBUG nova.network.neutron [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:16:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:16:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:16:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Creating image(s)
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "/opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "/opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "/opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.210s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG nova.network.neutron [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Updating instance_info_cache with network_info: [{"id": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "address": "fa:16:3e:05:a5:99", "network": {"id": "a4adecd1-dbe1-4cef-917c-522e65d07da7", "bridge": "br-int", "label": "tempest-TestShelveInstance-933324279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48441e65eff8478f9a562b9cec17af11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9eb011a-7d", "ovs_interfaceid": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Releasing lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Instance network_info: |[{"id": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "address": "fa:16:3e:05:a5:99", "network": {"id": "a4adecd1-dbe1-4cef-917c-522e65d07da7", "bridge": "br-int", "label": "tempest-TestShelveInstance-933324279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48441e65eff8478f9a562b9cec17af11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9eb011a-7d", "ovs_interfaceid": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1725386b-d2a8-42bf-91b2-e41b16436f07 req-462e6e45-9fc7-402c-8290-237a24bb347f service nova] Acquired lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG nova.network.neutron [req-1725386b-d2a8-42bf-91b2-e41b16436f07 req-462e6e45-9fc7-402c-8290-237a24bb347f service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Refreshing network info cache for port f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG nova.policy [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '193403aa9c4549cd936453ab6ef9c1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84db3210bb264fa8a51ff058417879cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.206s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk 1073741824" returned: 0 in 0.056s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Cannot resize image /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lazy-loading 'migration_context' on Instance uuid 4db26226-32ce-458d-ab6c-8019ae0032fd {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Ensure instance console log exists: /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-1725386b-d2a8-42bf-91b2-e41b16436f07 req-462e6e45-9fc7-402c-8290-237a24bb347f service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Updated VIF entry in instance network info cache for port f9eb011a-7d5c-4be9-b942-892f3bd8da61. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG nova.network.neutron [req-1725386b-d2a8-42bf-91b2-e41b16436f07 req-462e6e45-9fc7-402c-8290-237a24bb347f service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Updating instance_info_cache with network_info: [{"id": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "address": "fa:16:3e:05:a5:99", "network": {"id": "a4adecd1-dbe1-4cef-917c-522e65d07da7", "bridge": "br-int", "label": "tempest-TestShelveInstance-933324279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48441e65eff8478f9a562b9cec17af11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9eb011a-7d", "ovs_interfaceid": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-1725386b-d2a8-42bf-91b2-e41b16436f07 req-462e6e45-9fc7-402c-8290-237a24bb347f service nova] Releasing lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:16:39 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Successfully created port: 4d90ba09-5f00-4d5b-aa2b-4c175593a04f {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:16:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Successfully updated port: 4d90ba09-5f00-4d5b-aa2b-4c175593a04f {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:16:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "refresh_cache-4db26226-32ce-458d-ab6c-8019ae0032fd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:16:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquired lock "refresh_cache-4db26226-32ce-458d-ab6c-8019ae0032fd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:16:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:16:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-6abc0d49-e95a-4d3f-b2d8-0777b9a1ac52 req-c63eaac0-639f-4a89-ace1-d0def54274fa service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Received event network-changed-4d90ba09-5f00-4d5b-aa2b-4c175593a04f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-6abc0d49-e95a-4d3f-b2d8-0777b9a1ac52 req-c63eaac0-639f-4a89-ace1-d0def54274fa service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Refreshing instance network info cache due to event network-changed-4d90ba09-5f00-4d5b-aa2b-4c175593a04f. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:16:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6abc0d49-e95a-4d3f-b2d8-0777b9a1ac52 req-c63eaac0-639f-4a89-ace1-d0def54274fa service nova] Acquiring lock "refresh_cache-4db26226-32ce-458d-ab6c-8019ae0032fd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:16:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:16:40 user nova-compute[73091]: DEBUG nova.network.neutron [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Updating instance_info_cache with network_info: [{"id": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "address": "fa:16:3e:e1:a8:25", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d90ba09-5f", "ovs_interfaceid": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:16:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Releasing lock "refresh_cache-4db26226-32ce-458d-ab6c-8019ae0032fd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:16:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Instance network_info: |[{"id": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "address": "fa:16:3e:e1:a8:25", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d90ba09-5f", "ovs_interfaceid": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:16:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6abc0d49-e95a-4d3f-b2d8-0777b9a1ac52 req-c63eaac0-639f-4a89-ace1-d0def54274fa service nova] Acquired lock "refresh_cache-4db26226-32ce-458d-ab6c-8019ae0032fd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:16:40 user nova-compute[73091]: DEBUG nova.network.neutron [req-6abc0d49-e95a-4d3f-b2d8-0777b9a1ac52 req-c63eaac0-639f-4a89-ace1-d0def54274fa service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Refreshing network info cache for port 4d90ba09-5f00-4d5b-aa2b-4c175593a04f {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:16:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Start _get_guest_xml network_info=[{"id": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "address": "fa:16:3e:e1:a8:25", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d90ba09-5f", "ovs_interfaceid": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:16:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:16:41 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1286495614',display_name='tempest-VolumesAdminNegativeTest-server-1286495614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1286495614',id=21,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84db3210bb264fa8a51ff058417879cf',ramdisk_id='',reservation_id='r-em00dvim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-285658015',owner_user_name='tempest-VolumesAdminNegativeTest-285658015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:16:38Z,user_data=None,user_id='193403aa9c4549cd936453ab6ef9c1d1',uuid=4db26226-32ce-458d-ab6c-8019ae0032fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "address": "fa:16:3e:e1:a8:25", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d90ba09-5f", "ovs_interfaceid": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Converting VIF {"id": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "address": "fa:16:3e:e1:a8:25", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d90ba09-5f", "ovs_interfaceid": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a8:25,bridge_name='br-int',has_traffic_filtering=True,id=4d90ba09-5f00-4d5b-aa2b-4c175593a04f,network=Network(323e7b6f-721c-4ee0-aa42-fea90e1b7e97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d90ba09-5f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lazy-loading 'pci_devices' on Instance uuid 4db26226-32ce-458d-ab6c-8019ae0032fd {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:16:41 user nova-compute[73091]:   <uuid>4db26226-32ce-458d-ab6c-8019ae0032fd</uuid>
Aug 16 08:16:41 user nova-compute[73091]:   <name>instance-00000015</name>
Aug 16 08:16:41 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:16:41 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:16:41 user nova-compute[73091]:   <metadata>
Aug 16 08:16:41 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:16:41 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:16:41 user nova-compute[73091]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1286495614</nova:name>
Aug 16 08:16:41 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:16:41</nova:creationTime>
Aug 16 08:16:41 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:16:41 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:16:41 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:16:41 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:16:41 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:16:41 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:16:41 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:16:41 user nova-compute[73091]:       <nova:owner>
Aug 16 08:16:41 user nova-compute[73091]:         <nova:user uuid="193403aa9c4549cd936453ab6ef9c1d1">tempest-VolumesAdminNegativeTest-285658015-project-member</nova:user>
Aug 16 08:16:41 user nova-compute[73091]:         <nova:project uuid="84db3210bb264fa8a51ff058417879cf">tempest-VolumesAdminNegativeTest-285658015</nova:project>
Aug 16 08:16:41 user nova-compute[73091]:       </nova:owner>
Aug 16 08:16:41 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:16:41 user nova-compute[73091]:       <nova:ports>
Aug 16 08:16:41 user nova-compute[73091]:         <nova:port uuid="4d90ba09-5f00-4d5b-aa2b-4c175593a04f">
Aug 16 08:16:41 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 08:16:41 user nova-compute[73091]:         </nova:port>
Aug 16 08:16:41 user nova-compute[73091]:       </nova:ports>
Aug 16 08:16:41 user nova-compute[73091]:     </nova:instance>
Aug 16 08:16:41 user nova-compute[73091]:   </metadata>
Aug 16 08:16:41 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:16:41 user nova-compute[73091]:     <system>
Aug 16 08:16:41 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:16:41 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:16:41 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:16:41 user nova-compute[73091]:       <entry name="serial">4db26226-32ce-458d-ab6c-8019ae0032fd</entry>
Aug 16 08:16:41 user nova-compute[73091]:       <entry name="uuid">4db26226-32ce-458d-ab6c-8019ae0032fd</entry>
Aug 16 08:16:41 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:16:41 user nova-compute[73091]:     </system>
Aug 16 08:16:41 user nova-compute[73091]:   </sysinfo>
Aug 16 08:16:41 user nova-compute[73091]:   <os>
Aug 16 08:16:41 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:16:41 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:16:41 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:16:41 user nova-compute[73091]:   </os>
Aug 16 08:16:41 user nova-compute[73091]:   <features>
Aug 16 08:16:41 user nova-compute[73091]:     <acpi/>
Aug 16 08:16:41 user nova-compute[73091]:     <apic/>
Aug 16 08:16:41 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:16:41 user nova-compute[73091]:   </features>
Aug 16 08:16:41 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:16:41 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:16:41 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:16:41 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:16:41 user nova-compute[73091]:   </clock>
Aug 16 08:16:41 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:16:41 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:16:41 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:16:41 user nova-compute[73091]:   </cpu>
Aug 16 08:16:41 user nova-compute[73091]:   <devices>
Aug 16 08:16:41 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:16:41 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:16:41 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk"/>
Aug 16 08:16:41 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:16:41 user nova-compute[73091]:     </disk>
Aug 16 08:16:41 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:16:41 user nova-compute[73091]:       <mac address="fa:16:3e:e1:a8:25"/>
Aug 16 08:16:41 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:16:41 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:16:41 user nova-compute[73091]:       <target dev="tap4d90ba09-5f"/>
Aug 16 08:16:41 user nova-compute[73091]:     </interface>
Aug 16 08:16:41 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:16:41 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/console.log" append="off"/>
Aug 16 08:16:41 user nova-compute[73091]:     </serial>
Aug 16 08:16:41 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:16:41 user nova-compute[73091]:     <video>
Aug 16 08:16:41 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:16:41 user nova-compute[73091]:     </video>
Aug 16 08:16:41 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:16:41 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:16:41 user nova-compute[73091]:     </rng>
Aug 16 08:16:41 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:16:41 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:16:41 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:16:41 user nova-compute[73091]:     </memballoon>
Aug 16 08:16:41 user nova-compute[73091]:   </devices>
Aug 16 08:16:41 user nova-compute[73091]: </domain>
Aug 16 08:16:41 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1286495614',display_name='tempest-VolumesAdminNegativeTest-server-1286495614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1286495614',id=21,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84db3210bb264fa8a51ff058417879cf',ramdisk_id='',reservation_id='r-em00dvim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-285658015',owner_user_name='tempest-VolumesAdminNegativeTest-285658015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:16:38Z,user_data=None,user_id='193403aa9c4549cd936453ab6ef9c1d1',uuid=4db26226-32ce-458d-ab6c-8019ae0032fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "address": "fa:16:3e:e1:a8:25", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d90ba09-5f", "ovs_interfaceid": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Converting VIF {"id": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "address": "fa:16:3e:e1:a8:25", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d90ba09-5f", "ovs_interfaceid": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a8:25,bridge_name='br-int',has_traffic_filtering=True,id=4d90ba09-5f00-4d5b-aa2b-4c175593a04f,network=Network(323e7b6f-721c-4ee0-aa42-fea90e1b7e97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d90ba09-5f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG os_vif [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a8:25,bridge_name='br-int',has_traffic_filtering=True,id=4d90ba09-5f00-4d5b-aa2b-4c175593a04f,network=Network(323e7b6f-721c-4ee0-aa42-fea90e1b7e97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d90ba09-5f') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d90ba09-5f, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d90ba09-5f, col_values=(('external_ids', {'iface-id': '4d90ba09-5f00-4d5b-aa2b-4c175593a04f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:a8:25', 'vm-uuid': '4db26226-32ce-458d-ab6c-8019ae0032fd'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:41 user nova-compute[73091]: INFO os_vif [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a8:25,bridge_name='br-int',has_traffic_filtering=True,id=4d90ba09-5f00-4d5b-aa2b-4c175593a04f,network=Network(323e7b6f-721c-4ee0-aa42-fea90e1b7e97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d90ba09-5f')
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] No VIF found with MAC fa:16:3e:e1:a8:25, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.network.neutron [req-6abc0d49-e95a-4d3f-b2d8-0777b9a1ac52 req-c63eaac0-639f-4a89-ace1-d0def54274fa service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Updated VIF entry in instance network info cache for port 4d90ba09-5f00-4d5b-aa2b-4c175593a04f. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG nova.network.neutron [req-6abc0d49-e95a-4d3f-b2d8-0777b9a1ac52 req-c63eaac0-639f-4a89-ace1-d0def54274fa service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Updating instance_info_cache with network_info: [{"id": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "address": "fa:16:3e:e1:a8:25", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d90ba09-5f", "ovs_interfaceid": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:16:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6abc0d49-e95a-4d3f-b2d8-0777b9a1ac52 req-c63eaac0-639f-4a89-ace1-d0def54274fa service nova] Releasing lock "refresh_cache-4db26226-32ce-458d-ab6c-8019ae0032fd" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:16:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-b70afb68-76aa-47f9-97d4-309a63908466 req-c254326d-e757-4fc7-a649-76ee5bf31d17 service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Received event network-vif-plugged-4d90ba09-5f00-4d5b-aa2b-4c175593a04f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b70afb68-76aa-47f9-97d4-309a63908466 req-c254326d-e757-4fc7-a649-76ee5bf31d17 service nova] Acquiring lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b70afb68-76aa-47f9-97d4-309a63908466 req-c254326d-e757-4fc7-a649-76ee5bf31d17 service nova] Lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b70afb68-76aa-47f9-97d4-309a63908466 req-c254326d-e757-4fc7-a649-76ee5bf31d17 service nova] Lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:42 user nova-compute[73091]: DEBUG nova.compute.manager [req-b70afb68-76aa-47f9-97d4-309a63908466 req-c254326d-e757-4fc7-a649-76ee5bf31d17 service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] No waiting events found dispatching network-vif-plugged-4d90ba09-5f00-4d5b-aa2b-4c175593a04f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:16:42 user nova-compute[73091]: WARNING nova.compute.manager [req-b70afb68-76aa-47f9-97d4-309a63908466 req-c254326d-e757-4fc7-a649-76ee5bf31d17 service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Received unexpected event network-vif-plugged-4d90ba09-5f00-4d5b-aa2b-4c175593a04f for instance with vm_state building and task_state spawning.
Aug 16 08:16:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173804.8235698, 4db26226-32ce-458d-ab6c-8019ae0032fd => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:16:44 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] VM Resumed (Lifecycle Event)
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:16:44 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Instance spawned successfully.
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:16:44 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173804.8250787, 4db26226-32ce-458d-ab6c-8019ae0032fd => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:16:44 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] VM Started (Lifecycle Event)
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:16:44 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-ab87210e-532f-4cf6-bea1-1058097f3f36 req-3bc337b1-def6-4b12-b31f-fe4cd4561c71 service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Received event network-vif-plugged-4d90ba09-5f00-4d5b-aa2b-4c175593a04f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ab87210e-532f-4cf6-bea1-1058097f3f36 req-3bc337b1-def6-4b12-b31f-fe4cd4561c71 service nova] Acquiring lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ab87210e-532f-4cf6-bea1-1058097f3f36 req-3bc337b1-def6-4b12-b31f-fe4cd4561c71 service nova] Lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ab87210e-532f-4cf6-bea1-1058097f3f36 req-3bc337b1-def6-4b12-b31f-fe4cd4561c71 service nova] Lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-ab87210e-532f-4cf6-bea1-1058097f3f36 req-3bc337b1-def6-4b12-b31f-fe4cd4561c71 service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] No waiting events found dispatching network-vif-plugged-4d90ba09-5f00-4d5b-aa2b-4c175593a04f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:16:44 user nova-compute[73091]: WARNING nova.compute.manager [req-ab87210e-532f-4cf6-bea1-1058097f3f36 req-3bc337b1-def6-4b12-b31f-fe4cd4561c71 service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Received unexpected event network-vif-plugged-4d90ba09-5f00-4d5b-aa2b-4c175593a04f for instance with vm_state building and task_state spawning.
Aug 16 08:16:44 user nova-compute[73091]: INFO nova.compute.manager [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Took 6.64 seconds to spawn the instance on the hypervisor.
Aug 16 08:16:44 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:16:45 user nova-compute[73091]: INFO nova.compute.manager [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Took 7.65 seconds to build instance.
Aug 16 08:16:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1e4fa0ba-7f06-4808-9406-5e039bbf6ab9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "4db26226-32ce-458d-ab6c-8019ae0032fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.769s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:16:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Creating image(s)
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Ensure instance console log exists: /opt/stack/data/nova/instances/b989d006-e422-41eb-94f4-69667f2c26fe/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Start _get_guest_xml network_info=[{"id": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "address": "fa:16:3e:05:a5:99", "network": {"id": "a4adecd1-dbe1-4cef-917c-522e65d07da7", "bridge": "br-int", "label": "tempest-TestShelveInstance-933324279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48441e65eff8478f9a562b9cec17af11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9eb011a-7d", "ovs_interfaceid": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '1a3b1362-502a-4762-92b2-9790b9ce45f7', 'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RwUNVltE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b989d006-e422-41eb-94f4-69667f2c26fe', 'attached_at': '', 'detached_at': '', 'volume_id': 'a81fcd58-6d6c-4192-abcc-e8a0f4a48992', 'serial': 'a81fcd58-6d6c-4192-abcc-e8a0f4a48992'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:16:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:16:46 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RwUNVltE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:16:46 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:16:46 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:16:46 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d11859-659f-477e-9231-518acde41b82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:16:46 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[31580c04-c924-4bcf-afbc-a7c479e110ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992] added
Aug 16 08:16:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[39020c8d-7cfd-4b10-ac2c-e6c303618e27]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cabd9cd-b0b8-4164-93ba-8a57fb08021d]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RwUNVltE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RwUNVltE" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[826cf2c1-51f0-4e45-9511-25492e8482a5]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RwUNVltE'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa6f18e-8d86-4890-b2ba-455e1b4805f3]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[95020b3b-c804-4e8b-8e7a-c7fa16b7c752]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:16:46 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:16:46 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:16:46 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:16:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:16:46 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:16:46 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:16:46 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:16:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9796ebd4-befa-45b4-b467-e3492497ac8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992, portal: 172.16.0.220,3260]
Aug 16 08:16:46 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992, portal: 172.16.0.220,3260] successful.
Aug 16 08:16:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[091b7c4c-32f0-40ad-93dc-52e08af0ece0]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce071d4d-35fe-4ec2-ab86-e5db3a353b87]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:16:46 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:16:46 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:16:46 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:16:46 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:16:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:16:46 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:16:46 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:16:46 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:16:46 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:16:46 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[478ed8d9-14a1-4b59-87f0-753c82231153]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:16:46 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RwUNVltE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26532616133373731', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532616133373731', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-961399317',display_name='tempest-TestShelveInstance-server-961399317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-961399317',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgCoqmOvVcPifa6WcPHvVV74vDspI2ASN1zTG+1XaqND59EL2J0UY3jvMAI1AEhjXS4HzPZpW603j2VSgtwNn3AQLnzBif2nEywZ5psXdMgHmCL1JCS6FjtY0a5L1ZsLA==',key_name='tempest-TestShelveInstance-1740614777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48441e65eff8478f9a562b9cec17af11',ramdisk_id='',reservation_id='r-yq99aynu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-404090758',owner_user_name='tempest-TestShelveInstance-404090758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:16:36Z,user_data=None,user_id='24b833578e0341aab439f8a2f611d3b3',uuid=b989d006-e422-41eb-94f4-69667f2c26fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "address": "fa:16:3e:05:a5:99", "network": {"id": "a4adecd1-dbe1-4cef-917c-522e65d07da7", "bridge": "br-int", "label": "tempest-TestShelveInstance-933324279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48441e65eff8478f9a562b9cec17af11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9eb011a-7d", "ovs_interfaceid": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Converting VIF {"id": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "address": "fa:16:3e:05:a5:99", "network": {"id": "a4adecd1-dbe1-4cef-917c-522e65d07da7", "bridge": "br-int", "label": "tempest-TestShelveInstance-933324279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48441e65eff8478f9a562b9cec17af11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9eb011a-7d", "ovs_interfaceid": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:a5:99,bridge_name='br-int',has_traffic_filtering=True,id=f9eb011a-7d5c-4be9-b942-892f3bd8da61,network=Network(a4adecd1-dbe1-4cef-917c-522e65d07da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9eb011a-7d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lazy-loading 'pci_devices' on Instance uuid b989d006-e422-41eb-94f4-69667f2c26fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:16:47 user nova-compute[73091]:   <uuid>b989d006-e422-41eb-94f4-69667f2c26fe</uuid>
Aug 16 08:16:47 user nova-compute[73091]:   <name>instance-00000014</name>
Aug 16 08:16:47 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:16:47 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:16:47 user nova-compute[73091]:   <metadata>
Aug 16 08:16:47 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:16:47 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:16:47 user nova-compute[73091]:       <nova:name>tempest-TestShelveInstance-server-961399317</nova:name>
Aug 16 08:16:47 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:16:46</nova:creationTime>
Aug 16 08:16:47 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:16:47 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:16:47 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:16:47 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:16:47 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:16:47 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:16:47 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:16:47 user nova-compute[73091]:       <nova:owner>
Aug 16 08:16:47 user nova-compute[73091]:         <nova:user uuid="24b833578e0341aab439f8a2f611d3b3">tempest-TestShelveInstance-404090758-project-member</nova:user>
Aug 16 08:16:47 user nova-compute[73091]:         <nova:project uuid="48441e65eff8478f9a562b9cec17af11">tempest-TestShelveInstance-404090758</nova:project>
Aug 16 08:16:47 user nova-compute[73091]:       </nova:owner>
Aug 16 08:16:47 user nova-compute[73091]:       <nova:ports>
Aug 16 08:16:47 user nova-compute[73091]:         <nova:port uuid="f9eb011a-7d5c-4be9-b942-892f3bd8da61">
Aug 16 08:16:47 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 08:16:47 user nova-compute[73091]:         </nova:port>
Aug 16 08:16:47 user nova-compute[73091]:       </nova:ports>
Aug 16 08:16:47 user nova-compute[73091]:     </nova:instance>
Aug 16 08:16:47 user nova-compute[73091]:   </metadata>
Aug 16 08:16:47 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:16:47 user nova-compute[73091]:     <system>
Aug 16 08:16:47 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:16:47 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:16:47 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:16:47 user nova-compute[73091]:       <entry name="serial">b989d006-e422-41eb-94f4-69667f2c26fe</entry>
Aug 16 08:16:47 user nova-compute[73091]:       <entry name="uuid">b989d006-e422-41eb-94f4-69667f2c26fe</entry>
Aug 16 08:16:47 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:16:47 user nova-compute[73091]:     </system>
Aug 16 08:16:47 user nova-compute[73091]:   </sysinfo>
Aug 16 08:16:47 user nova-compute[73091]:   <os>
Aug 16 08:16:47 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:16:47 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:16:47 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:16:47 user nova-compute[73091]:   </os>
Aug 16 08:16:47 user nova-compute[73091]:   <features>
Aug 16 08:16:47 user nova-compute[73091]:     <acpi/>
Aug 16 08:16:47 user nova-compute[73091]:     <apic/>
Aug 16 08:16:47 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:16:47 user nova-compute[73091]:   </features>
Aug 16 08:16:47 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:16:47 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:16:47 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:16:47 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:16:47 user nova-compute[73091]:   </clock>
Aug 16 08:16:47 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:16:47 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:16:47 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:16:47 user nova-compute[73091]:   </cpu>
Aug 16 08:16:47 user nova-compute[73091]:   <devices>
Aug 16 08:16:47 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:16:47 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:16:47 user nova-compute[73091]:       <source dev="/dev/sdf"/>
Aug 16 08:16:47 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:16:47 user nova-compute[73091]:       <serial>a81fcd58-6d6c-4192-abcc-e8a0f4a48992</serial>
Aug 16 08:16:47 user nova-compute[73091]:     </disk>
Aug 16 08:16:47 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:16:47 user nova-compute[73091]:       <mac address="fa:16:3e:05:a5:99"/>
Aug 16 08:16:47 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:16:47 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:16:47 user nova-compute[73091]:       <target dev="tapf9eb011a-7d"/>
Aug 16 08:16:47 user nova-compute[73091]:     </interface>
Aug 16 08:16:47 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:16:47 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/b989d006-e422-41eb-94f4-69667f2c26fe/console.log" append="off"/>
Aug 16 08:16:47 user nova-compute[73091]:     </serial>
Aug 16 08:16:47 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:16:47 user nova-compute[73091]:     <video>
Aug 16 08:16:47 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:16:47 user nova-compute[73091]:     </video>
Aug 16 08:16:47 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:16:47 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:16:47 user nova-compute[73091]:     </rng>
Aug 16 08:16:47 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:16:47 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:16:47 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:16:47 user nova-compute[73091]:     </memballoon>
Aug 16 08:16:47 user nova-compute[73091]:   </devices>
Aug 16 08:16:47 user nova-compute[73091]: </domain>
Aug 16 08:16:47 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-961399317',display_name='tempest-TestShelveInstance-server-961399317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-961399317',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgCoqmOvVcPifa6WcPHvVV74vDspI2ASN1zTG+1XaqND59EL2J0UY3jvMAI1AEhjXS4HzPZpW603j2VSgtwNn3AQLnzBif2nEywZ5psXdMgHmCL1JCS6FjtY0a5L1ZsLA==',key_name='tempest-TestShelveInstance-1740614777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48441e65eff8478f9a562b9cec17af11',ramdisk_id='',reservation_id='r-yq99aynu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-404090758',owner_user_name='tempest-TestShelveInstance-404090758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:16:36Z,user_data=None,user_id='24b833578e0341aab439f8a2f611d3b3',uuid=b989d006-e422-41eb-94f4-69667f2c26fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "address": "fa:16:3e:05:a5:99", "network": {"id": "a4adecd1-dbe1-4cef-917c-522e65d07da7", "bridge": "br-int", "label": "tempest-TestShelveInstance-933324279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48441e65eff8478f9a562b9cec17af11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9eb011a-7d", "ovs_interfaceid": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Converting VIF {"id": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "address": "fa:16:3e:05:a5:99", "network": {"id": "a4adecd1-dbe1-4cef-917c-522e65d07da7", "bridge": "br-int", "label": "tempest-TestShelveInstance-933324279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48441e65eff8478f9a562b9cec17af11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9eb011a-7d", "ovs_interfaceid": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:a5:99,bridge_name='br-int',has_traffic_filtering=True,id=f9eb011a-7d5c-4be9-b942-892f3bd8da61,network=Network(a4adecd1-dbe1-4cef-917c-522e65d07da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9eb011a-7d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG os_vif [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:a5:99,bridge_name='br-int',has_traffic_filtering=True,id=f9eb011a-7d5c-4be9-b942-892f3bd8da61,network=Network(a4adecd1-dbe1-4cef-917c-522e65d07da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9eb011a-7d') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9eb011a-7d, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9eb011a-7d, col_values=(('external_ids', {'iface-id': 'f9eb011a-7d5c-4be9-b942-892f3bd8da61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:a5:99', 'vm-uuid': 'b989d006-e422-41eb-94f4-69667f2c26fe'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:16:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:47 user nova-compute[73091]: INFO os_vif [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:a5:99,bridge_name='br-int',has_traffic_filtering=True,id=f9eb011a-7d5c-4be9-b942-892f3bd8da61,network=Network(a4adecd1-dbe1-4cef-917c-522e65d07da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9eb011a-7d')
Aug 16 08:16:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:16:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] No VIF found with MAC fa:16:3e:05:a5:99, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:16:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-8b308a65-b7bb-4fce-a125-ca1fb5d5f522 req-98a64578-2a9d-4854-a9e7-40b4409d39ff service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Received event network-vif-plugged-f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8b308a65-b7bb-4fce-a125-ca1fb5d5f522 req-98a64578-2a9d-4854-a9e7-40b4409d39ff service nova] Acquiring lock "b989d006-e422-41eb-94f4-69667f2c26fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8b308a65-b7bb-4fce-a125-ca1fb5d5f522 req-98a64578-2a9d-4854-a9e7-40b4409d39ff service nova] Lock "b989d006-e422-41eb-94f4-69667f2c26fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8b308a65-b7bb-4fce-a125-ca1fb5d5f522 req-98a64578-2a9d-4854-a9e7-40b4409d39ff service nova] Lock "b989d006-e422-41eb-94f4-69667f2c26fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-8b308a65-b7bb-4fce-a125-ca1fb5d5f522 req-98a64578-2a9d-4854-a9e7-40b4409d39ff service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] No waiting events found dispatching network-vif-plugged-f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:16:49 user nova-compute[73091]: WARNING nova.compute.manager [req-8b308a65-b7bb-4fce-a125-ca1fb5d5f522 req-98a64578-2a9d-4854-a9e7-40b4409d39ff service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Received unexpected event network-vif-plugged-f9eb011a-7d5c-4be9-b942-892f3bd8da61 for instance with vm_state building and task_state spawning.
Aug 16 08:16:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173811.6460748, b989d006-e422-41eb-94f4-69667f2c26fe => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:16:51 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] VM Resumed (Lifecycle Event)
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:16:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Instance spawned successfully.
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:16:51 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173811.6482012, b989d006-e422-41eb-94f4-69667f2c26fe => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:16:51 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] VM Started (Lifecycle Event)
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:16:51 user nova-compute[73091]: INFO nova.compute.manager [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Took 5.34 seconds to spawn the instance on the hypervisor.
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.compute.manager [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:16:51 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-73a477fb-704a-42aa-8536-21b01bf81343 req-b5dc5e72-c209-4874-bbd5-5b89271084b7 service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Received event network-vif-plugged-f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73a477fb-704a-42aa-8536-21b01bf81343 req-b5dc5e72-c209-4874-bbd5-5b89271084b7 service nova] Acquiring lock "b989d006-e422-41eb-94f4-69667f2c26fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73a477fb-704a-42aa-8536-21b01bf81343 req-b5dc5e72-c209-4874-bbd5-5b89271084b7 service nova] Lock "b989d006-e422-41eb-94f4-69667f2c26fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-73a477fb-704a-42aa-8536-21b01bf81343 req-b5dc5e72-c209-4874-bbd5-5b89271084b7 service nova] Lock "b989d006-e422-41eb-94f4-69667f2c26fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:51 user nova-compute[73091]: DEBUG nova.compute.manager [req-73a477fb-704a-42aa-8536-21b01bf81343 req-b5dc5e72-c209-4874-bbd5-5b89271084b7 service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] No waiting events found dispatching network-vif-plugged-f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:16:51 user nova-compute[73091]: WARNING nova.compute.manager [req-73a477fb-704a-42aa-8536-21b01bf81343 req-b5dc5e72-c209-4874-bbd5-5b89271084b7 service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Received unexpected event network-vif-plugged-f9eb011a-7d5c-4be9-b942-892f3bd8da61 for instance with vm_state building and task_state spawning.
Aug 16 08:16:51 user nova-compute[73091]: INFO nova.compute.manager [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Took 17.08 seconds to build instance.
Aug 16 08:16:51 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-eb44d483-9571-4fbe-9984-e3843f33afb7 tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "b989d006-e422-41eb-94f4-69667f2c26fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.183s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-2e6dda44-31d2-4490-8680-63546c1b8341 req-a63450f5-1b3a-4957-94b7-20efca1c24bd service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received event network-changed-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-2e6dda44-31d2-4490-8680-63546c1b8341 req-a63450f5-1b3a-4957-94b7-20efca1c24bd service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Refreshing instance network info cache due to event network-changed-998d8399-d10e-4085-bd9f-c8a1f3022645. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:16:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2e6dda44-31d2-4490-8680-63546c1b8341 req-a63450f5-1b3a-4957-94b7-20efca1c24bd service nova] Acquiring lock "refresh_cache-80448987-5965-47bd-ad0b-28cf031f5dea" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:16:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2e6dda44-31d2-4490-8680-63546c1b8341 req-a63450f5-1b3a-4957-94b7-20efca1c24bd service nova] Acquired lock "refresh_cache-80448987-5965-47bd-ad0b-28cf031f5dea" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:16:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-2e6dda44-31d2-4490-8680-63546c1b8341 req-a63450f5-1b3a-4957-94b7-20efca1c24bd service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Refreshing network info cache for port 998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "80448987-5965-47bd-ad0b-28cf031f5dea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "80448987-5965-47bd-ad0b-28cf031f5dea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:57 user nova-compute[73091]: INFO nova.compute.manager [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Terminating instance
Aug 16 08:16:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-2e6dda44-31d2-4490-8680-63546c1b8341 req-a63450f5-1b3a-4957-94b7-20efca1c24bd service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Updated VIF entry in instance network info cache for port 998d8399-d10e-4085-bd9f-c8a1f3022645. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-2e6dda44-31d2-4490-8680-63546c1b8341 req-a63450f5-1b3a-4957-94b7-20efca1c24bd service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Updating instance_info_cache with network_info: [{"id": "998d8399-d10e-4085-bd9f-c8a1f3022645", "address": "fa:16:3e:9b:b6:46", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8399-d1", "ovs_interfaceid": "998d8399-d10e-4085-bd9f-c8a1f3022645", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2e6dda44-31d2-4490-8680-63546c1b8341 req-a63450f5-1b3a-4957-94b7-20efca1c24bd service nova] Releasing lock "refresh_cache-80448987-5965-47bd-ad0b-28cf031f5dea" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-18246b02-2fbc-42e6-a883-7ceb5fa1f891 req-011fe595-5ae7-4422-bc50-bda5e66e536c service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received event network-vif-unplugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-18246b02-2fbc-42e6-a883-7ceb5fa1f891 req-011fe595-5ae7-4422-bc50-bda5e66e536c service nova] Acquiring lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-18246b02-2fbc-42e6-a883-7ceb5fa1f891 req-011fe595-5ae7-4422-bc50-bda5e66e536c service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-18246b02-2fbc-42e6-a883-7ceb5fa1f891 req-011fe595-5ae7-4422-bc50-bda5e66e536c service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-18246b02-2fbc-42e6-a883-7ceb5fa1f891 req-011fe595-5ae7-4422-bc50-bda5e66e536c service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] No waiting events found dispatching network-vif-unplugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-18246b02-2fbc-42e6-a883-7ceb5fa1f891 req-011fe595-5ae7-4422-bc50-bda5e66e536c service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received event network-vif-unplugged-998d8399-d10e-4085-bd9f-c8a1f3022645 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Instance destroyed successfully.
Aug 16 08:16:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lazy-loading 'resources' on Instance uuid 80448987-5965-47bd-ad0b-28cf031f5dea {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:15:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-208428893',display_name='tempest-AttachVolumeNegativeTest-server-208428893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-208428893',id=17,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0QHxIwNxCMHkSkW6wLWt5bj1xVj95b2vSTETn8XAzqZuEeoXhpgv2GWpSmE+iaFenFJKwPVQlW6+Hc1kYx/bY3u+79mVNdAMvWpOmq34r1qqWAPE1CPDQbPruEdy2Cyw==',key_name='tempest-keypair-1058417897',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:15:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8186c961465c48fc800e3b1ecd4ed077',ramdisk_id='',reservation_id='r-f0gu4wi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1216940805',owner_user_name='tempest-AttachVolumeNegativeTest-1216940805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:15:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='741b35d305b340bfb00ecffb56a143b8',uuid=80448987-5965-47bd-ad0b-28cf031f5dea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "998d8399-d10e-4085-bd9f-c8a1f3022645", "address": "fa:16:3e:9b:b6:46", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8399-d1", "ovs_interfaceid": "998d8399-d10e-4085-bd9f-c8a1f3022645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converting VIF {"id": "998d8399-d10e-4085-bd9f-c8a1f3022645", "address": "fa:16:3e:9b:b6:46", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap998d8399-d1", "ovs_interfaceid": "998d8399-d10e-4085-bd9f-c8a1f3022645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b6:46,bridge_name='br-int',has_traffic_filtering=True,id=998d8399-d10e-4085-bd9f-c8a1f3022645,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998d8399-d1') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG os_vif [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b6:46,bridge_name='br-int',has_traffic_filtering=True,id=998d8399-d10e-4085-bd9f-c8a1f3022645,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998d8399-d1') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap998d8399-d1, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:58 user nova-compute[73091]: INFO os_vif [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b6:46,bridge_name='br-int',has_traffic_filtering=True,id=998d8399-d10e-4085-bd9f-c8a1f3022645,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998d8399-d1')
Aug 16 08:16:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Deleting instance files /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea_del
Aug 16 08:16:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Deletion of /opt/stack/data/nova/instances/80448987-5965-47bd-ad0b-28cf031f5dea_del complete
Aug 16 08:16:58 user nova-compute[73091]: INFO nova.compute.manager [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 16 08:16:58 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-8c6ae540-f199-427f-8327-670714c292d6 req-4e05c559-604f-4389-9d43-24187110da51 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received event network-vif-deleted-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:59 user nova-compute[73091]: INFO nova.compute.manager [req-8c6ae540-f199-427f-8327-670714c292d6 req-4e05c559-604f-4389-9d43-24187110da51 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Neutron deleted interface 998d8399-d10e-4085-bd9f-c8a1f3022645; detaching it from the instance and deleting it from the info cache
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.network.neutron [req-8c6ae540-f199-427f-8327-670714c292d6 req-4e05c559-604f-4389-9d43-24187110da51 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:16:59 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Took 1.31 seconds to deallocate network for instance.
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-8c6ae540-f199-427f-8327-670714c292d6 req-4e05c559-604f-4389-9d43-24187110da51 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Detach interface failed, port_id=998d8399-d10e-4085-bd9f-c8a1f3022645, reason: Instance 80448987-5965-47bd-ad0b-28cf031f5dea could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received event network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Acquiring lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] No waiting events found dispatching network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:16:59 user nova-compute[73091]: WARNING nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received unexpected event network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 for instance with vm_state active and task_state deleting.
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received event network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Acquiring lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] No waiting events found dispatching network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:16:59 user nova-compute[73091]: WARNING nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received unexpected event network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 for instance with vm_state active and task_state deleting.
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received event network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Acquiring lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] No waiting events found dispatching network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:16:59 user nova-compute[73091]: WARNING nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received unexpected event network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 for instance with vm_state active and task_state deleting.
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received event network-vif-unplugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Acquiring lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] No waiting events found dispatching network-vif-unplugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received event network-vif-unplugged-998d8399-d10e-4085-bd9f-c8a1f3022645 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received event network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Acquiring lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] Lock "80448987-5965-47bd-ad0b-28cf031f5dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] No waiting events found dispatching network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:16:59 user nova-compute[73091]: WARNING nova.compute.manager [req-46cfff28-ea3c-4291-8ebf-2f4185218615 req-096d31de-234d-497f-92c1-5ee3d8516d40 service nova] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Received unexpected event network-vif-plugged-998d8399-d10e-4085-bd9f-c8a1f3022645 for instance with vm_state active and task_state deleting.
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:16:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:00 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:17:00 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:17:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.520s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:00 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Deleted allocations for instance 80448987-5965-47bd-ad0b-28cf031f5dea
Aug 16 08:17:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-01c4772a-4d63-417a-9807-e01beef06744 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "80448987-5965-47bd-ad0b-28cf031f5dea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.185s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "99b8e77d-d296-4e72-b961-2f94c925f9ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:17:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:02 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:02 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:17:02 user nova-compute[73091]: INFO nova.compute.claims [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Claim successful on node user
Aug 16 08:17:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG nova.network.neutron [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:17:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:17:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG nova.policy [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a24330919014a2985e7926747cbbcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417ed7a5d52f4f7eaa4b6328864808ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG nova.compute.manager [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:17:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Creating image(s)
Aug 16 08:17:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "/opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "/opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "/opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.211s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk 1073741824" returned: 0 in 0.048s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:04 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:17:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:04 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Cannot resize image /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:17:04 user nova-compute[73091]: DEBUG nova.objects.instance [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'migration_context' on Instance uuid 99b8e77d-d296-4e72-b961-2f94c925f9ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:17:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:17:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Ensure instance console log exists: /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:17:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:04 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:04 user nova-compute[73091]: DEBUG nova.network.neutron [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Successfully created port: d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Successfully updated port: d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "refresh_cache-99b8e77d-d296-4e72-b961-2f94c925f9ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquired lock "refresh_cache-99b8e77d-d296-4e72-b961-2f94c925f9ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb698a75-2c5c-4747-9e93-1985afdb35b9 req-fc43f9e4-aec9-4f02-abbe-d546509f781f service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Received event network-changed-d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.compute.manager [req-cb698a75-2c5c-4747-9e93-1985afdb35b9 req-fc43f9e4-aec9-4f02-abbe-d546509f781f service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Refreshing instance network info cache due to event network-changed-d5c717e4-8e0e-452f-9103-67e9410273e2. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb698a75-2c5c-4747-9e93-1985afdb35b9 req-fc43f9e4-aec9-4f02-abbe-d546509f781f service nova] Acquiring lock "refresh_cache-99b8e77d-d296-4e72-b961-2f94c925f9ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.network.neutron [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Updating instance_info_cache with network_info: [{"id": "d5c717e4-8e0e-452f-9103-67e9410273e2", "address": "fa:16:3e:fd:bc:4b", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c717e4-8e", "ovs_interfaceid": "d5c717e4-8e0e-452f-9103-67e9410273e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Releasing lock "refresh_cache-99b8e77d-d296-4e72-b961-2f94c925f9ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Instance network_info: |[{"id": "d5c717e4-8e0e-452f-9103-67e9410273e2", "address": "fa:16:3e:fd:bc:4b", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c717e4-8e", "ovs_interfaceid": "d5c717e4-8e0e-452f-9103-67e9410273e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb698a75-2c5c-4747-9e93-1985afdb35b9 req-fc43f9e4-aec9-4f02-abbe-d546509f781f service nova] Acquired lock "refresh_cache-99b8e77d-d296-4e72-b961-2f94c925f9ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.network.neutron [req-cb698a75-2c5c-4747-9e93-1985afdb35b9 req-fc43f9e4-aec9-4f02-abbe-d546509f781f service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Refreshing network info cache for port d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Start _get_guest_xml network_info=[{"id": "d5c717e4-8e0e-452f-9103-67e9410273e2", "address": "fa:16:3e:fd:bc:4b", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c717e4-8e", "ovs_interfaceid": "d5c717e4-8e0e-452f-9103-67e9410273e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:17:05 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:17:05 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1784357027',display_name='tempest-ServerRescueNegativeTestJSON-server-1784357027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1784357027',id=22,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcFLI3gIWyr2cc1kh2NjNyq3UfhIFXh3ffM5z66gNF8e9ytXcsANspmvOtri0iX1W/fC4OttZE+yE2MEuZBrGswiMg6mpXyDN9lDOFTtHLPxVGwS02dfGNfPyKXa4FcoA==',key_name='tempest-keypair-1615619142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='417ed7a5d52f4f7eaa4b6328864808ea',ramdisk_id='',reservation_id='r-7aow83dj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1374385894',owner_user_name='tempest-ServerRescueNegativeTestJSON-1374385894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a24330919014a2985e7926747cbbcdc',uuid=99b8e77d-d296-4e72-b961-2f94c925f9ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5c717e4-8e0e-452f-9103-67e9410273e2", "address": "fa:16:3e:fd:bc:4b", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c717e4-8e", "ovs_interfaceid": "d5c717e4-8e0e-452f-9103-67e9410273e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converting VIF {"id": "d5c717e4-8e0e-452f-9103-67e9410273e2", "address": "fa:16:3e:fd:bc:4b", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c717e4-8e", "ovs_interfaceid": "d5c717e4-8e0e-452f-9103-67e9410273e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:bc:4b,bridge_name='br-int',has_traffic_filtering=True,id=d5c717e4-8e0e-452f-9103-67e9410273e2,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c717e4-8e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.objects.instance [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'pci_devices' on Instance uuid 99b8e77d-d296-4e72-b961-2f94c925f9ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:17:05 user nova-compute[73091]:   <uuid>99b8e77d-d296-4e72-b961-2f94c925f9ba</uuid>
Aug 16 08:17:05 user nova-compute[73091]:   <name>instance-00000016</name>
Aug 16 08:17:05 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:17:05 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:17:05 user nova-compute[73091]:   <metadata>
Aug 16 08:17:05 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:17:05 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:17:05 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1784357027</nova:name>
Aug 16 08:17:05 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:17:05</nova:creationTime>
Aug 16 08:17:05 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:17:05 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:17:05 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:17:05 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:17:05 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:17:05 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:17:05 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:17:05 user nova-compute[73091]:       <nova:owner>
Aug 16 08:17:05 user nova-compute[73091]:         <nova:user uuid="7a24330919014a2985e7926747cbbcdc">tempest-ServerRescueNegativeTestJSON-1374385894-project-member</nova:user>
Aug 16 08:17:05 user nova-compute[73091]:         <nova:project uuid="417ed7a5d52f4f7eaa4b6328864808ea">tempest-ServerRescueNegativeTestJSON-1374385894</nova:project>
Aug 16 08:17:05 user nova-compute[73091]:       </nova:owner>
Aug 16 08:17:05 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:17:05 user nova-compute[73091]:       <nova:ports>
Aug 16 08:17:05 user nova-compute[73091]:         <nova:port uuid="d5c717e4-8e0e-452f-9103-67e9410273e2">
Aug 16 08:17:05 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 08:17:05 user nova-compute[73091]:         </nova:port>
Aug 16 08:17:05 user nova-compute[73091]:       </nova:ports>
Aug 16 08:17:05 user nova-compute[73091]:     </nova:instance>
Aug 16 08:17:05 user nova-compute[73091]:   </metadata>
Aug 16 08:17:05 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:17:05 user nova-compute[73091]:     <system>
Aug 16 08:17:05 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:17:05 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:17:05 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:17:05 user nova-compute[73091]:       <entry name="serial">99b8e77d-d296-4e72-b961-2f94c925f9ba</entry>
Aug 16 08:17:05 user nova-compute[73091]:       <entry name="uuid">99b8e77d-d296-4e72-b961-2f94c925f9ba</entry>
Aug 16 08:17:05 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:17:05 user nova-compute[73091]:     </system>
Aug 16 08:17:05 user nova-compute[73091]:   </sysinfo>
Aug 16 08:17:05 user nova-compute[73091]:   <os>
Aug 16 08:17:05 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:17:05 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:17:05 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:17:05 user nova-compute[73091]:   </os>
Aug 16 08:17:05 user nova-compute[73091]:   <features>
Aug 16 08:17:05 user nova-compute[73091]:     <acpi/>
Aug 16 08:17:05 user nova-compute[73091]:     <apic/>
Aug 16 08:17:05 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:17:05 user nova-compute[73091]:   </features>
Aug 16 08:17:05 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:17:05 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:17:05 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:17:05 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:17:05 user nova-compute[73091]:   </clock>
Aug 16 08:17:05 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:17:05 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:17:05 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:17:05 user nova-compute[73091]:   </cpu>
Aug 16 08:17:05 user nova-compute[73091]:   <devices>
Aug 16 08:17:05 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:17:05 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:17:05 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk"/>
Aug 16 08:17:05 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:17:05 user nova-compute[73091]:     </disk>
Aug 16 08:17:05 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:17:05 user nova-compute[73091]:       <mac address="fa:16:3e:fd:bc:4b"/>
Aug 16 08:17:05 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:17:05 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:17:05 user nova-compute[73091]:       <target dev="tapd5c717e4-8e"/>
Aug 16 08:17:05 user nova-compute[73091]:     </interface>
Aug 16 08:17:05 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:17:05 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/console.log" append="off"/>
Aug 16 08:17:05 user nova-compute[73091]:     </serial>
Aug 16 08:17:05 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:17:05 user nova-compute[73091]:     <video>
Aug 16 08:17:05 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:17:05 user nova-compute[73091]:     </video>
Aug 16 08:17:05 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:17:05 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:17:05 user nova-compute[73091]:     </rng>
Aug 16 08:17:05 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:17:05 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:17:05 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:17:05 user nova-compute[73091]:     </memballoon>
Aug 16 08:17:05 user nova-compute[73091]:   </devices>
Aug 16 08:17:05 user nova-compute[73091]: </domain>
Aug 16 08:17:05 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1784357027',display_name='tempest-ServerRescueNegativeTestJSON-server-1784357027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1784357027',id=22,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcFLI3gIWyr2cc1kh2NjNyq3UfhIFXh3ffM5z66gNF8e9ytXcsANspmvOtri0iX1W/fC4OttZE+yE2MEuZBrGswiMg6mpXyDN9lDOFTtHLPxVGwS02dfGNfPyKXa4FcoA==',key_name='tempest-keypair-1615619142',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='417ed7a5d52f4f7eaa4b6328864808ea',ramdisk_id='',reservation_id='r-7aow83dj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1374385894',owner_user_name='tempest-ServerRescueNegativeTestJSON-1374385894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a24330919014a2985e7926747cbbcdc',uuid=99b8e77d-d296-4e72-b961-2f94c925f9ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5c717e4-8e0e-452f-9103-67e9410273e2", "address": "fa:16:3e:fd:bc:4b", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c717e4-8e", "ovs_interfaceid": "d5c717e4-8e0e-452f-9103-67e9410273e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converting VIF {"id": "d5c717e4-8e0e-452f-9103-67e9410273e2", "address": "fa:16:3e:fd:bc:4b", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c717e4-8e", "ovs_interfaceid": "d5c717e4-8e0e-452f-9103-67e9410273e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:bc:4b,bridge_name='br-int',has_traffic_filtering=True,id=d5c717e4-8e0e-452f-9103-67e9410273e2,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c717e4-8e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG os_vif [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:bc:4b,bridge_name='br-int',has_traffic_filtering=True,id=d5c717e4-8e0e-452f-9103-67e9410273e2,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c717e4-8e') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5c717e4-8e, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5c717e4-8e, col_values=(('external_ids', {'iface-id': 'd5c717e4-8e0e-452f-9103-67e9410273e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:bc:4b', 'vm-uuid': '99b8e77d-d296-4e72-b961-2f94c925f9ba'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:17:05 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:05 user nova-compute[73091]: INFO os_vif [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:bc:4b,bridge_name='br-int',has_traffic_filtering=True,id=d5c717e4-8e0e-452f-9103-67e9410273e2,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c717e4-8e')
Aug 16 08:17:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:17:06 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No VIF found with MAC fa:16:3e:fd:bc:4b, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:17:06 user nova-compute[73091]: DEBUG nova.network.neutron [req-cb698a75-2c5c-4747-9e93-1985afdb35b9 req-fc43f9e4-aec9-4f02-abbe-d546509f781f service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Updated VIF entry in instance network info cache for port d5c717e4-8e0e-452f-9103-67e9410273e2. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:17:06 user nova-compute[73091]: DEBUG nova.network.neutron [req-cb698a75-2c5c-4747-9e93-1985afdb35b9 req-fc43f9e4-aec9-4f02-abbe-d546509f781f service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Updating instance_info_cache with network_info: [{"id": "d5c717e4-8e0e-452f-9103-67e9410273e2", "address": "fa:16:3e:fd:bc:4b", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c717e4-8e", "ovs_interfaceid": "d5c717e4-8e0e-452f-9103-67e9410273e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:17:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-cb698a75-2c5c-4747-9e93-1985afdb35b9 req-fc43f9e4-aec9-4f02-abbe-d546509f781f service nova] Releasing lock "refresh_cache-99b8e77d-d296-4e72-b961-2f94c925f9ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:17:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "464df5c5-3bcd-4985-a609-fb49b5f1be12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "464df5c5-3bcd-4985-a609-fb49b5f1be12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:17:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:07 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:17:07 user nova-compute[73091]: INFO nova.compute.claims [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Claim successful on node user
Aug 16 08:17:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-5b1c2e26-c358-4b32-a933-06a45393310c req-09468d25-1942-4894-b022-038973d0b7a1 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Received event network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:17:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5b1c2e26-c358-4b32-a933-06a45393310c req-09468d25-1942-4894-b022-038973d0b7a1 service nova] Acquiring lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5b1c2e26-c358-4b32-a933-06a45393310c req-09468d25-1942-4894-b022-038973d0b7a1 service nova] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5b1c2e26-c358-4b32-a933-06a45393310c req-09468d25-1942-4894-b022-038973d0b7a1 service nova] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:07 user nova-compute[73091]: DEBUG nova.compute.manager [req-5b1c2e26-c358-4b32-a933-06a45393310c req-09468d25-1942-4894-b022-038973d0b7a1 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] No waiting events found dispatching network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:17:07 user nova-compute[73091]: WARNING nova.compute.manager [req-5b1c2e26-c358-4b32-a933-06a45393310c req-09468d25-1942-4894-b022-038973d0b7a1 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Received unexpected event network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 for instance with vm_state building and task_state spawning.
Aug 16 08:17:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:08 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:17:08 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:17:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:17:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:17:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:17:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:17:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:17:08 user nova-compute[73091]: DEBUG nova.policy [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '196d845c007043b3aead43d76d94df07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85ea39234954b05a5a5b21cc52b30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:17:08 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:17:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:17:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Creating image(s)
Aug 16 08:17:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "/opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "/opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "/opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk 1073741824" returned: 0 in 0.051s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Successfully created port: fb1f6924-6c19-48dd-9c07-639f6e3237f0 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Cannot resize image /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lazy-loading 'migration_context' on Instance uuid 464df5c5-3bcd-4985-a609-fb49b5f1be12 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Ensure instance console log exists: /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-2f7cb02d-58df-47c4-8dcf-e43fb69578e7 req-d7ee086c-2662-43c5-ac8d-ec39eefb15b8 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Received event network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2f7cb02d-58df-47c4-8dcf-e43fb69578e7 req-d7ee086c-2662-43c5-ac8d-ec39eefb15b8 service nova] Acquiring lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2f7cb02d-58df-47c4-8dcf-e43fb69578e7 req-d7ee086c-2662-43c5-ac8d-ec39eefb15b8 service nova] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2f7cb02d-58df-47c4-8dcf-e43fb69578e7 req-d7ee086c-2662-43c5-ac8d-ec39eefb15b8 service nova] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-2f7cb02d-58df-47c4-8dcf-e43fb69578e7 req-d7ee086c-2662-43c5-ac8d-ec39eefb15b8 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] No waiting events found dispatching network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:17:09 user nova-compute[73091]: WARNING nova.compute.manager [req-2f7cb02d-58df-47c4-8dcf-e43fb69578e7 req-d7ee086c-2662-43c5-ac8d-ec39eefb15b8 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Received unexpected event network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 for instance with vm_state building and task_state spawning.
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Successfully updated port: fb1f6924-6c19-48dd-9c07-639f6e3237f0 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "refresh_cache-464df5c5-3bcd-4985-a609-fb49b5f1be12" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquired lock "refresh_cache-464df5c5-3bcd-4985-a609-fb49b5f1be12" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-661406a2-efa6-4ff0-8961-5f3547e83fd4 req-1a92ea83-1a1a-4755-a77a-4e3edb8e9d7e service nova] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Received event network-changed-fb1f6924-6c19-48dd-9c07-639f6e3237f0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-661406a2-efa6-4ff0-8961-5f3547e83fd4 req-1a92ea83-1a1a-4755-a77a-4e3edb8e9d7e service nova] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Refreshing instance network info cache due to event network-changed-fb1f6924-6c19-48dd-9c07-639f6e3237f0. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-661406a2-efa6-4ff0-8961-5f3547e83fd4 req-1a92ea83-1a1a-4755-a77a-4e3edb8e9d7e service nova] Acquiring lock "refresh_cache-464df5c5-3bcd-4985-a609-fb49b5f1be12" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173830.0874312, 99b8e77d-d296-4e72-b961-2f94c925f9ba => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:17:10 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] VM Resumed (Lifecycle Event)
Aug 16 08:17:10 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Instance spawned successfully.
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:17:10 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173830.0875795, 99b8e77d-d296-4e72-b961-2f94c925f9ba => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:17:10 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] VM Started (Lifecycle Event)
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:17:10 user nova-compute[73091]: INFO nova.compute.manager [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Took 6.69 seconds to spawn the instance on the hypervisor.
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:17:10 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:17:10 user nova-compute[73091]: INFO nova.compute.manager [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Took 7.65 seconds to build instance.
Aug 16 08:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-19bad85c-ddc2-4dad-81fd-0613a6740b9b tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.748s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Updating instance_info_cache with network_info: [{"id": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "address": "fa:16:3e:ce:c6:46", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f6924-6c", "ovs_interfaceid": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Releasing lock "refresh_cache-464df5c5-3bcd-4985-a609-fb49b5f1be12" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Instance network_info: |[{"id": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "address": "fa:16:3e:ce:c6:46", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f6924-6c", "ovs_interfaceid": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-661406a2-efa6-4ff0-8961-5f3547e83fd4 req-1a92ea83-1a1a-4755-a77a-4e3edb8e9d7e service nova] Acquired lock "refresh_cache-464df5c5-3bcd-4985-a609-fb49b5f1be12" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-661406a2-efa6-4ff0-8961-5f3547e83fd4 req-1a92ea83-1a1a-4755-a77a-4e3edb8e9d7e service nova] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Refreshing network info cache for port fb1f6924-6c19-48dd-9c07-639f6e3237f0 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Start _get_guest_xml network_info=[{"id": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "address": "fa:16:3e:ce:c6:46", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f6924-6c", "ovs_interfaceid": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:17:10 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:17:10 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-457008724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-457008724',id=23,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c85ea39234954b05a5a5b21cc52b30ec',ramdisk_id='',reservation_id='r-klhavch4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1623646564',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:17:09Z,user_data=None,user_id='196d845c007043b3aead43d76d94df07',uuid=464df5c5-3bcd-4985-a609-fb49b5f1be12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "address": "fa:16:3e:ce:c6:46", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f6924-6c", "ovs_interfaceid": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Converting VIF {"id": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "address": "fa:16:3e:ce:c6:46", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f6924-6c", "ovs_interfaceid": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c6:46,bridge_name='br-int',has_traffic_filtering=True,id=fb1f6924-6c19-48dd-9c07-639f6e3237f0,network=Network(231d0163-8e3c-408f-bc7d-92a34ba1fde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1f6924-6c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lazy-loading 'pci_devices' on Instance uuid 464df5c5-3bcd-4985-a609-fb49b5f1be12 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:17:10 user nova-compute[73091]:   <uuid>464df5c5-3bcd-4985-a609-fb49b5f1be12</uuid>
Aug 16 08:17:10 user nova-compute[73091]:   <name>instance-00000017</name>
Aug 16 08:17:10 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:17:10 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:17:10 user nova-compute[73091]:   <metadata>
Aug 16 08:17:10 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:17:10 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:17:10 user nova-compute[73091]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-457008724</nova:name>
Aug 16 08:17:10 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:17:10</nova:creationTime>
Aug 16 08:17:10 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:17:10 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:17:10 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:17:10 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:17:10 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:17:10 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:17:10 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:17:10 user nova-compute[73091]:       <nova:owner>
Aug 16 08:17:10 user nova-compute[73091]:         <nova:user uuid="196d845c007043b3aead43d76d94df07">tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member</nova:user>
Aug 16 08:17:10 user nova-compute[73091]:         <nova:project uuid="c85ea39234954b05a5a5b21cc52b30ec">tempest-ServerBootFromVolumeStableRescueTest-1623646564</nova:project>
Aug 16 08:17:10 user nova-compute[73091]:       </nova:owner>
Aug 16 08:17:10 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:17:10 user nova-compute[73091]:       <nova:ports>
Aug 16 08:17:10 user nova-compute[73091]:         <nova:port uuid="fb1f6924-6c19-48dd-9c07-639f6e3237f0">
Aug 16 08:17:10 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 08:17:10 user nova-compute[73091]:         </nova:port>
Aug 16 08:17:10 user nova-compute[73091]:       </nova:ports>
Aug 16 08:17:10 user nova-compute[73091]:     </nova:instance>
Aug 16 08:17:10 user nova-compute[73091]:   </metadata>
Aug 16 08:17:10 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:17:10 user nova-compute[73091]:     <system>
Aug 16 08:17:10 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:17:10 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:17:10 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:17:10 user nova-compute[73091]:       <entry name="serial">464df5c5-3bcd-4985-a609-fb49b5f1be12</entry>
Aug 16 08:17:10 user nova-compute[73091]:       <entry name="uuid">464df5c5-3bcd-4985-a609-fb49b5f1be12</entry>
Aug 16 08:17:10 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:17:10 user nova-compute[73091]:     </system>
Aug 16 08:17:10 user nova-compute[73091]:   </sysinfo>
Aug 16 08:17:10 user nova-compute[73091]:   <os>
Aug 16 08:17:10 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:17:10 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:17:10 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:17:10 user nova-compute[73091]:   </os>
Aug 16 08:17:10 user nova-compute[73091]:   <features>
Aug 16 08:17:10 user nova-compute[73091]:     <acpi/>
Aug 16 08:17:10 user nova-compute[73091]:     <apic/>
Aug 16 08:17:10 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:17:10 user nova-compute[73091]:   </features>
Aug 16 08:17:10 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:17:10 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:17:10 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:17:10 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:17:10 user nova-compute[73091]:   </clock>
Aug 16 08:17:10 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:17:10 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:17:10 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:17:10 user nova-compute[73091]:   </cpu>
Aug 16 08:17:10 user nova-compute[73091]:   <devices>
Aug 16 08:17:10 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:17:10 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:17:10 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk"/>
Aug 16 08:17:10 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:17:10 user nova-compute[73091]:     </disk>
Aug 16 08:17:10 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:17:10 user nova-compute[73091]:       <mac address="fa:16:3e:ce:c6:46"/>
Aug 16 08:17:10 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:17:10 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:17:10 user nova-compute[73091]:       <target dev="tapfb1f6924-6c"/>
Aug 16 08:17:10 user nova-compute[73091]:     </interface>
Aug 16 08:17:10 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:17:10 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/console.log" append="off"/>
Aug 16 08:17:10 user nova-compute[73091]:     </serial>
Aug 16 08:17:10 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:17:10 user nova-compute[73091]:     <video>
Aug 16 08:17:10 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:17:10 user nova-compute[73091]:     </video>
Aug 16 08:17:10 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:17:10 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:17:10 user nova-compute[73091]:     </rng>
Aug 16 08:17:10 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:17:10 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:17:10 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:17:10 user nova-compute[73091]:     </memballoon>
Aug 16 08:17:10 user nova-compute[73091]:   </devices>
Aug 16 08:17:10 user nova-compute[73091]: </domain>
Aug 16 08:17:10 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-457008724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-457008724',id=23,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c85ea39234954b05a5a5b21cc52b30ec',ramdisk_id='',reservation_id='r-klhavch4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1623646564',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:17:09Z,user_data=None,user_id='196d845c007043b3aead43d76d94df07',uuid=464df5c5-3bcd-4985-a609-fb49b5f1be12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "address": "fa:16:3e:ce:c6:46", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f6924-6c", "ovs_interfaceid": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Converting VIF {"id": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "address": "fa:16:3e:ce:c6:46", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f6924-6c", "ovs_interfaceid": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c6:46,bridge_name='br-int',has_traffic_filtering=True,id=fb1f6924-6c19-48dd-9c07-639f6e3237f0,network=Network(231d0163-8e3c-408f-bc7d-92a34ba1fde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1f6924-6c') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG os_vif [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c6:46,bridge_name='br-int',has_traffic_filtering=True,id=fb1f6924-6c19-48dd-9c07-639f6e3237f0,network=Network(231d0163-8e3c-408f-bc7d-92a34ba1fde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1f6924-6c') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb1f6924-6c, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb1f6924-6c, col_values=(('external_ids', {'iface-id': 'fb1f6924-6c19-48dd-9c07-639f6e3237f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:c6:46', 'vm-uuid': '464df5c5-3bcd-4985-a609-fb49b5f1be12'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:10 user nova-compute[73091]: INFO os_vif [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c6:46,bridge_name='br-int',has_traffic_filtering=True,id=fb1f6924-6c19-48dd-9c07-639f6e3237f0,network=Network(231d0163-8e3c-408f-bc7d-92a34ba1fde3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1f6924-6c')
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] No VIF found with MAC fa:16:3e:ce:c6:46, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-661406a2-efa6-4ff0-8961-5f3547e83fd4 req-1a92ea83-1a1a-4755-a77a-4e3edb8e9d7e service nova] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Updated VIF entry in instance network info cache for port fb1f6924-6c19-48dd-9c07-639f6e3237f0. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG nova.network.neutron [req-661406a2-efa6-4ff0-8961-5f3547e83fd4 req-1a92ea83-1a1a-4755-a77a-4e3edb8e9d7e service nova] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Updating instance_info_cache with network_info: [{"id": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "address": "fa:16:3e:ce:c6:46", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1f6924-6c", "ovs_interfaceid": "fb1f6924-6c19-48dd-9c07-639f6e3237f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:17:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-661406a2-efa6-4ff0-8961-5f3547e83fd4 req-1a92ea83-1a1a-4755-a77a-4e3edb8e9d7e service nova] Releasing lock "refresh_cache-464df5c5-3bcd-4985-a609-fb49b5f1be12" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:17:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-f81836d7-bf52-43e5-9dbe-5b3311cd9754 req-94448ef8-952e-4fd0-ae87-bdf9103b1896 service nova] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Received event network-vif-plugged-fb1f6924-6c19-48dd-9c07-639f6e3237f0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:17:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f81836d7-bf52-43e5-9dbe-5b3311cd9754 req-94448ef8-952e-4fd0-ae87-bdf9103b1896 service nova] Acquiring lock "464df5c5-3bcd-4985-a609-fb49b5f1be12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f81836d7-bf52-43e5-9dbe-5b3311cd9754 req-94448ef8-952e-4fd0-ae87-bdf9103b1896 service nova] Lock "464df5c5-3bcd-4985-a609-fb49b5f1be12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f81836d7-bf52-43e5-9dbe-5b3311cd9754 req-94448ef8-952e-4fd0-ae87-bdf9103b1896 service nova] Lock "464df5c5-3bcd-4985-a609-fb49b5f1be12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-f81836d7-bf52-43e5-9dbe-5b3311cd9754 req-94448ef8-952e-4fd0-ae87-bdf9103b1896 service nova] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] No waiting events found dispatching network-vif-plugged-fb1f6924-6c19-48dd-9c07-639f6e3237f0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:17:12 user nova-compute[73091]: WARNING nova.compute.manager [req-f81836d7-bf52-43e5-9dbe-5b3311cd9754 req-94448ef8-952e-4fd0-ae87-bdf9103b1896 service nova] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Received unexpected event network-vif-plugged-fb1f6924-6c19-48dd-9c07-639f6e3237f0 for instance with vm_state building and task_state spawning.
Aug 16 08:17:13 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173818.080752, 80448987-5965-47bd-ad0b-28cf031f5dea => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:17:13 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] VM Stopped (Lifecycle Event)
Aug 16 08:17:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-409f0453-2ac6-49d4-8157-177e5cdb8d7e None None] [instance: 80448987-5965-47bd-ad0b-28cf031f5dea] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-8a302bdc-9332-44bd-80f2-fc51a1897b20 req-ca188a8b-2e6e-4a6d-9fb6-ee4e4d172cf6 service nova] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Received event network-vif-plugged-fb1f6924-6c19-48dd-9c07-639f6e3237f0 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a302bdc-9332-44bd-80f2-fc51a1897b20 req-ca188a8b-2e6e-4a6d-9fb6-ee4e4d172cf6 service nova] Acquiring lock "464df5c5-3bcd-4985-a609-fb49b5f1be12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a302bdc-9332-44bd-80f2-fc51a1897b20 req-ca188a8b-2e6e-4a6d-9fb6-ee4e4d172cf6 service nova] Lock "464df5c5-3bcd-4985-a609-fb49b5f1be12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-8a302bdc-9332-44bd-80f2-fc51a1897b20 req-ca188a8b-2e6e-4a6d-9fb6-ee4e4d172cf6 service nova] Lock "464df5c5-3bcd-4985-a609-fb49b5f1be12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.compute.manager [req-8a302bdc-9332-44bd-80f2-fc51a1897b20 req-ca188a8b-2e6e-4a6d-9fb6-ee4e4d172cf6 service nova] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] No waiting events found dispatching network-vif-plugged-fb1f6924-6c19-48dd-9c07-639f6e3237f0 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:17:14 user nova-compute[73091]: WARNING nova.compute.manager [req-8a302bdc-9332-44bd-80f2-fc51a1897b20 req-ca188a8b-2e6e-4a6d-9fb6-ee4e4d172cf6 service nova] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Received unexpected event network-vif-plugged-fb1f6924-6c19-48dd-9c07-639f6e3237f0 for instance with vm_state building and task_state spawning.
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173834.7729437, 464df5c5-3bcd-4985-a609-fb49b5f1be12 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:17:14 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] VM Resumed (Lifecycle Event)
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:17:14 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Instance spawned successfully.
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:17:14 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173834.7761643, 464df5c5-3bcd-4985-a609-fb49b5f1be12 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:17:14 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] VM Started (Lifecycle Event)
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:17:14 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:17:14 user nova-compute[73091]: INFO nova.compute.manager [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Took 6.23 seconds to spawn the instance on the hypervisor.
Aug 16 08:17:14 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:17:15 user nova-compute[73091]: INFO nova.compute.manager [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Took 7.50 seconds to build instance.
Aug 16 08:17:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9c4912cb-10c1-4ec9-90ca-c7168f37fe79 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "464df5c5-3bcd-4985-a609-fb49b5f1be12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.619s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:23 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:17:24 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:17:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:17:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "refresh_cache-cc7973d9-c703-4345-bf58-ccbe80fd07ac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:17:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquired lock "refresh_cache-cc7973d9-c703-4345-bf58-ccbe80fd07ac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:17:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 08:17:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:24 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Updating instance_info_cache with network_info: [{"id": "75463757-0a11-47fa-8270-d756556eb589", "address": "fa:16:3e:c3:27:58", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75463757-0a", "ovs_interfaceid": "75463757-0a11-47fa-8270-d756556eb589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:17:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Releasing lock "refresh_cache-cc7973d9-c703-4345-bf58-ccbe80fd07ac" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:17:24 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: cc7973d9-c703-4345-bf58-ccbe80fd07ac] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 08:17:24 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:17:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:24 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:24 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:17:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "18850651-02ac-459a-838c-b3216bcbe131" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:25 user nova-compute[73091]: INFO nova.compute.manager [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Detaching volume 10ee6294-f727-4e2b-b6ec-3d1e8a1d7881
Aug 16 08:17:25 user nova-compute[73091]: INFO nova.virt.block_device [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Attempting to driver detach volume 10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 from mountpoint /dev/vdb
Aug 16 08:17:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Attempting to detach device vdb from instance 18850651-02ac-459a-838c-b3216bcbe131 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 08:17:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:17:25 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:17:25 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 08:17:25 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:17:25 user nova-compute[73091]:   <serial>10ee6294-f727-4e2b-b6ec-3d1e8a1d7881</serial>
Aug 16 08:17:25 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 08:17:25 user nova-compute[73091]: </disk>
Aug 16 08:17:25 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:17:25 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Successfully detached device vdb from instance 18850651-02ac-459a-838c-b3216bcbe131 from the persistent domain config.
Aug 16 08:17:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 18850651-02ac-459a-838c-b3216bcbe131 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 08:17:25 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:17:25 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:17:25 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 08:17:25 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:17:25 user nova-compute[73091]:   <serial>10ee6294-f727-4e2b-b6ec-3d1e8a1d7881</serial>
Aug 16 08:17:25 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 08:17:25 user nova-compute[73091]: </disk>
Aug 16 08:17:25 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:17:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:25 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:25 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Received event <DeviceRemovedEvent: 1692173846.0155587, 18850651-02ac-459a-838c-b3216bcbe131 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 18850651-02ac-459a-838c-b3216bcbe131 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 08:17:26 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Successfully detached device vdb from instance 18850651-02ac-459a-838c-b3216bcbe131 from the live domain config.
Aug 16 08:17:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waVECumk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:17:26 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b01668-437d-43a1-b127-ad1f2ab7b236]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ee24c3-bab8-4cad-b83a-a3b636368ce6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:17:26 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:17:26 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:17:26 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:17:26 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:17:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:17:26 user nova-compute[73091]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 (non-flash)
Aug 16 08:17:26 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:17:26 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:17:26 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:17:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8cc41c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f79646-7209-4270-bc37-547b9ceea7a1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8368e1c1-559d-4a46-9d6a-179faf52aeb6]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e733f61-f8d3-4420-b808-4feb4a14e599]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a43f240-8fbf-4e3f-8636-17a5d563d1f1]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc38bd9-a3c4-461f-8442-399ff3ca5997]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb1b913-86d8-4835-8f48-7c63ac30161d]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260]
Aug 16 08:17:26 user nova-compute[73091]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881, portal: 172.16.0.220,3260] successful.
Aug 16 08:17:26 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ee6294-f727-4e2b-b6ec-3d1e8a1d7881 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf7b675-df0f-4a4e-b645-3ef174939f87]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] <== disconnect_volume: return (333ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:27 user nova-compute[73091]: DEBUG nova.objects.instance [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lazy-loading 'flavor' on Instance uuid 18850651-02ac-459a-838c-b3216bcbe131 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:17:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6f579b33-1f82-4884-b9fc-840605938c25 tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "18850651-02ac-459a-838c-b3216bcbe131" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.906s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json" returned: 0 in 0.379s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:17:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:17:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:30 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:17:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:17:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:31 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:17:31 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=6567MB free_disk=25.270099639892578GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance bd541280-cecf-4c1c-bd1f-f7edff830f1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4a6248b9-f577-4efd-baa2-eb5eb3e47495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance cc7973d9-c703-4345-bf58-ccbe80fd07ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance daf2b789-eba2-419b-99f6-be8f483151ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4f76c866-84a8-499c-a96c-21a2d65ca3d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 18850651-02ac-459a-838c-b3216bcbe131 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 7aded393-c408-48d9-a30c-78b62ce0d09e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 476de8ea-30dd-4b52-be37-f134e445757f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 935af9fd-600a-4c48-873b-b39126081748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 6a927702-8a5e-47d8-99de-b049f20b29a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance a79098c3-784e-4315-8fd0-0ff883d4f6e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance b989d006-e422-41eb-94f4-69667f2c26fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4db26226-32ce-458d-ab6c-8019ae0032fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 99b8e77d-d296-4e72-b961-2f94c925f9ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 464df5c5-3bcd-4985-a609-fb49b5f1be12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:17:31 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:17:32 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:17:32 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:17:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:17:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:17:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:17:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:17:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:17:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:17:32 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:17:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:17:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:35 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:40 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:41 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-3c30852d-8bd1-47c0-8688-d8df0610451b req-d53b7695-9213-4906-9a50-217554de6239 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Received event network-changed-2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:17:44 user nova-compute[73091]: DEBUG nova.compute.manager [req-3c30852d-8bd1-47c0-8688-d8df0610451b req-d53b7695-9213-4906-9a50-217554de6239 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Refreshing instance network info cache due to event network-changed-2334292e-6adb-4800-a26e-26c91045e0f2. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:17:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c30852d-8bd1-47c0-8688-d8df0610451b req-d53b7695-9213-4906-9a50-217554de6239 service nova] Acquiring lock "refresh_cache-6a927702-8a5e-47d8-99de-b049f20b29a3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:17:44 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c30852d-8bd1-47c0-8688-d8df0610451b req-d53b7695-9213-4906-9a50-217554de6239 service nova] Acquired lock "refresh_cache-6a927702-8a5e-47d8-99de-b049f20b29a3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:17:44 user nova-compute[73091]: DEBUG nova.network.neutron [req-3c30852d-8bd1-47c0-8688-d8df0610451b req-d53b7695-9213-4906-9a50-217554de6239 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Refreshing network info cache for port 2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:17:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-3c30852d-8bd1-47c0-8688-d8df0610451b req-d53b7695-9213-4906-9a50-217554de6239 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Updated VIF entry in instance network info cache for port 2334292e-6adb-4800-a26e-26c91045e0f2. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:17:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-3c30852d-8bd1-47c0-8688-d8df0610451b req-d53b7695-9213-4906-9a50-217554de6239 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Updating instance_info_cache with network_info: [{"id": "2334292e-6adb-4800-a26e-26c91045e0f2", "address": "fa:16:3e:d1:2f:86", "network": {"id": "ff14bf7f-3994-42a9-8de1-5426de17b16d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bd6561008748148418f8a5a3e3d382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2334292e-6a", "ovs_interfaceid": "2334292e-6adb-4800-a26e-26c91045e0f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:17:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-3c30852d-8bd1-47c0-8688-d8df0610451b req-d53b7695-9213-4906-9a50-217554de6239 service nova] Releasing lock "refresh_cache-6a927702-8a5e-47d8-99de-b049f20b29a3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:17:45 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:45 user nova-compute[73091]: DEBUG nova.compute.manager [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:17:45 user nova-compute[73091]: INFO nova.compute.manager [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] instance snapshotting
Aug 16 08:17:45 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Beginning live snapshot process
Aug 16 08:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:46 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv92m9fsl/a7237a1f28d74297a21c288b1395ca02.delta 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv92m9fsl/a7237a1f28d74297a21c288b1395ca02.delta 1073741824" returned: 0 in 0.051s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:46 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 08:17:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:17:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:17:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 08:17:48 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 08:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv92m9fsl/a7237a1f28d74297a21c288b1395ca02.delta /opt/stack/data/nova/instances/snapshots/tmpv92m9fsl/a7237a1f28d74297a21c288b1395ca02 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv92m9fsl/a7237a1f28d74297a21c288b1395ca02.delta /opt/stack/data/nova/instances/snapshots/tmpv92m9fsl/a7237a1f28d74297a21c288b1395ca02" returned: 0 in 0.459s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Snapshot extracted, beginning image upload
Aug 16 08:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "7aded393-c408-48d9-a30c-78b62ce0d09e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:48 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:48 user nova-compute[73091]: INFO nova.compute.manager [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Detaching volume 041d5c22-3852-41f9-985d-bb7e8dca4997
Aug 16 08:17:48 user nova-compute[73091]: INFO nova.virt.block_device [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Attempting to driver detach volume 041d5c22-3852-41f9-985d-bb7e8dca4997 from mountpoint /dev/vdb
Aug 16 08:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Attempting to detach device vdb from instance 7aded393-c408-48d9-a30c-78b62ce0d09e from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 08:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:17:48 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:17:48 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 16 08:17:48 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:17:48 user nova-compute[73091]:   <serial>041d5c22-3852-41f9-985d-bb7e8dca4997</serial>
Aug 16 08:17:48 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 08:17:48 user nova-compute[73091]: </disk>
Aug 16 08:17:48 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:17:48 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Successfully detached device vdb from instance 7aded393-c408-48d9-a30c-78b62ce0d09e from the persistent domain config.
Aug 16 08:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7aded393-c408-48d9-a30c-78b62ce0d09e from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 08:17:48 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:17:48 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:17:48 user nova-compute[73091]:   <source dev="/dev/sdd"/>
Aug 16 08:17:48 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:17:48 user nova-compute[73091]:   <serial>041d5c22-3852-41f9-985d-bb7e8dca4997</serial>
Aug 16 08:17:48 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 08:17:48 user nova-compute[73091]: </disk>
Aug 16 08:17:48 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Received event <DeviceRemovedEvent: 1692173869.4284759, 7aded393-c408-48d9-a30c-78b62ce0d09e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7aded393-c408-48d9-a30c-78b62ce0d09e {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 08:17:49 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Successfully detached device vdb from instance 7aded393-c408-48d9-a30c-78b62ce0d09e from the live domain config.
Aug 16 08:17:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLuUsFij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:17:49 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f956e41-4c69-4e55-bc75-bcfe5e4d31e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[182fe944-2e60-428b-8775-b6e79c02401e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:17:49 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:17:49 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:17:49 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:17:49 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:17:49 user nova-compute[73091]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 (non-flash)
Aug 16 08:17:49 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:17:49 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:17:49 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8cc6f5360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c12f8ed-d7dc-453f-8578-954d1d648090]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1e689a-26aa-450a-8fb8-667f1c609027]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a707b501-723b-495f-b62b-d6eaab24e5a2]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ca1529-3ae0-4c60-9b46-cd3358401bc6]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb2226b-275f-4370-8216-fe08b9835c3b]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6d1c87-4515-4e13-a418-dff1c3e7ee37]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997, portal: 172.16.0.220,3260]
Aug 16 08:17:49 user nova-compute[73091]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997, portal: 172.16.0.220,3260] successful.
Aug 16 08:17:49 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:041d5c22-3852-41f9-985d-bb7e8dca4997 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[46929e66-6ce7-4b57-b9f5-8072698d0e98]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] <== disconnect_volume: return (304ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:17:49 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:17:50 user nova-compute[73091]: DEBUG nova.objects.instance [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lazy-loading 'flavor' on Instance uuid 7aded393-c408-48d9-a30c-78b62ce0d09e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:17:50 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-2cf5275f-37eb-482d-871a-f19bf2bb2f57 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.752s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:50 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:51 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Snapshot image upload complete
Aug 16 08:17:51 user nova-compute[73091]: INFO nova.compute.manager [None req-39633021-c5a2-4880-a4d9-a211be7186af tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Took 5.41 seconds to snapshot the instance on the hypervisor.
Aug 16 08:17:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Acquiring lock "4bfc7896-7001-48e3-a768-1030c3eb8485" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "4bfc7896-7001-48e3-a768-1030c3eb8485" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:52 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:17:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:52 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:52 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:17:52 user nova-compute[73091]: INFO nova.compute.claims [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Claim successful on node user
Aug 16 08:17:53 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG nova.network.neutron [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:17:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:17:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG nova.policy [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46b5670aeead481cba521126a1fc8b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cfd89a8bc47518de5a75998ab8ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:17:53 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Creating image(s)
Aug 16 08:17:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "/opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "/opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.171s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk 1073741824" returned: 0 in 0.048s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:54 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:17:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:54 user nova-compute[73091]: DEBUG nova.network.neutron [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Successfully created port: 517d5e72-8716-47bd-87b3-e61fcc3b1257 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:17:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:54 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Cannot resize image /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:17:54 user nova-compute[73091]: DEBUG nova.objects.instance [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lazy-loading 'migration_context' on Instance uuid 4bfc7896-7001-48e3-a768-1030c3eb8485 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:17:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:17:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Ensure instance console log exists: /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:17:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Successfully updated port: 517d5e72-8716-47bd-87b3-e61fcc3b1257 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:17:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Acquiring lock "refresh_cache-4bfc7896-7001-48e3-a768-1030c3eb8485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:17:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Acquired lock "refresh_cache-4bfc7896-7001-48e3-a768-1030c3eb8485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:17:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:17:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-e5893edc-3300-447f-a32e-9fd409647992 req-e051dc55-6f6c-43a2-bd35-0b067f960c74 service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Received event network-changed-517d5e72-8716-47bd-87b3-e61fcc3b1257 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:17:55 user nova-compute[73091]: DEBUG nova.compute.manager [req-e5893edc-3300-447f-a32e-9fd409647992 req-e051dc55-6f6c-43a2-bd35-0b067f960c74 service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Refreshing instance network info cache due to event network-changed-517d5e72-8716-47bd-87b3-e61fcc3b1257. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:17:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e5893edc-3300-447f-a32e-9fd409647992 req-e051dc55-6f6c-43a2-bd35-0b067f960c74 service nova] Acquiring lock "refresh_cache-4bfc7896-7001-48e3-a768-1030c3eb8485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:17:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:17:55 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Updating instance_info_cache with network_info: [{"id": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "address": "fa:16:3e:bf:58:1a", "network": {"id": "6beb82b7-1250-42a3-8a36-5c0eb0f52f8f", "bridge": "br-int", "label": "tempest-TestStampPattern-1309048302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10cfd89a8bc47518de5a75998ab8ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517d5e72-87", "ovs_interfaceid": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Releasing lock "refresh_cache-4bfc7896-7001-48e3-a768-1030c3eb8485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Instance network_info: |[{"id": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "address": "fa:16:3e:bf:58:1a", "network": {"id": "6beb82b7-1250-42a3-8a36-5c0eb0f52f8f", "bridge": "br-int", "label": "tempest-TestStampPattern-1309048302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10cfd89a8bc47518de5a75998ab8ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517d5e72-87", "ovs_interfaceid": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e5893edc-3300-447f-a32e-9fd409647992 req-e051dc55-6f6c-43a2-bd35-0b067f960c74 service nova] Acquired lock "refresh_cache-4bfc7896-7001-48e3-a768-1030c3eb8485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-e5893edc-3300-447f-a32e-9fd409647992 req-e051dc55-6f6c-43a2-bd35-0b067f960c74 service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Refreshing network info cache for port 517d5e72-8716-47bd-87b3-e61fcc3b1257 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Start _get_guest_xml network_info=[{"id": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "address": "fa:16:3e:bf:58:1a", "network": {"id": "6beb82b7-1250-42a3-8a36-5c0eb0f52f8f", "bridge": "br-int", "label": "tempest-TestStampPattern-1309048302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10cfd89a8bc47518de5a75998ab8ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517d5e72-87", "ovs_interfaceid": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:17:56 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:17:56 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-570263048',display_name='tempest-TestStampPattern-server-570263048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-570263048',id=24,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjY6hgQa1AAGwykaBRcZc2nV+rEL8dDo+6sTGH8/byGV51hXtlwTwEczEaF87ayXTwpvU3ti3UJOIGlBUaU2Lfeh32bVYrEH/DNgzXWAcwYl53VOKHo1I7cthoxw0e5aw==',key_name='tempest-TestStampPattern-1619597978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f10cfd89a8bc47518de5a75998ab8ade',ramdisk_id='',reservation_id='r-mctfgeo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-472046926',owner_user_name='tempest-TestStampPattern-472046926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:17:53Z,user_data=None,user_id='46b5670aeead481cba521126a1fc8b49',uuid=4bfc7896-7001-48e3-a768-1030c3eb8485,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "address": "fa:16:3e:bf:58:1a", "network": {"id": "6beb82b7-1250-42a3-8a36-5c0eb0f52f8f", "bridge": "br-int", "label": "tempest-TestStampPattern-1309048302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10cfd89a8bc47518de5a75998ab8ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517d5e72-87", "ovs_interfaceid": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Converting VIF {"id": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "address": "fa:16:3e:bf:58:1a", "network": {"id": "6beb82b7-1250-42a3-8a36-5c0eb0f52f8f", "bridge": "br-int", "label": "tempest-TestStampPattern-1309048302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10cfd89a8bc47518de5a75998ab8ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517d5e72-87", "ovs_interfaceid": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:58:1a,bridge_name='br-int',has_traffic_filtering=True,id=517d5e72-8716-47bd-87b3-e61fcc3b1257,network=Network(6beb82b7-1250-42a3-8a36-5c0eb0f52f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap517d5e72-87') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.objects.instance [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bfc7896-7001-48e3-a768-1030c3eb8485 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:17:56 user nova-compute[73091]:   <uuid>4bfc7896-7001-48e3-a768-1030c3eb8485</uuid>
Aug 16 08:17:56 user nova-compute[73091]:   <name>instance-00000018</name>
Aug 16 08:17:56 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:17:56 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:17:56 user nova-compute[73091]:   <metadata>
Aug 16 08:17:56 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:17:56 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:17:56 user nova-compute[73091]:       <nova:name>tempest-TestStampPattern-server-570263048</nova:name>
Aug 16 08:17:56 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:17:56</nova:creationTime>
Aug 16 08:17:56 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:17:56 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:17:56 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:17:56 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:17:56 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:17:56 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:17:56 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:17:56 user nova-compute[73091]:       <nova:owner>
Aug 16 08:17:56 user nova-compute[73091]:         <nova:user uuid="46b5670aeead481cba521126a1fc8b49">tempest-TestStampPattern-472046926-project-member</nova:user>
Aug 16 08:17:56 user nova-compute[73091]:         <nova:project uuid="f10cfd89a8bc47518de5a75998ab8ade">tempest-TestStampPattern-472046926</nova:project>
Aug 16 08:17:56 user nova-compute[73091]:       </nova:owner>
Aug 16 08:17:56 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:17:56 user nova-compute[73091]:       <nova:ports>
Aug 16 08:17:56 user nova-compute[73091]:         <nova:port uuid="517d5e72-8716-47bd-87b3-e61fcc3b1257">
Aug 16 08:17:56 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 08:17:56 user nova-compute[73091]:         </nova:port>
Aug 16 08:17:56 user nova-compute[73091]:       </nova:ports>
Aug 16 08:17:56 user nova-compute[73091]:     </nova:instance>
Aug 16 08:17:56 user nova-compute[73091]:   </metadata>
Aug 16 08:17:56 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:17:56 user nova-compute[73091]:     <system>
Aug 16 08:17:56 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:17:56 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:17:56 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:17:56 user nova-compute[73091]:       <entry name="serial">4bfc7896-7001-48e3-a768-1030c3eb8485</entry>
Aug 16 08:17:56 user nova-compute[73091]:       <entry name="uuid">4bfc7896-7001-48e3-a768-1030c3eb8485</entry>
Aug 16 08:17:56 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:17:56 user nova-compute[73091]:     </system>
Aug 16 08:17:56 user nova-compute[73091]:   </sysinfo>
Aug 16 08:17:56 user nova-compute[73091]:   <os>
Aug 16 08:17:56 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:17:56 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:17:56 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:17:56 user nova-compute[73091]:   </os>
Aug 16 08:17:56 user nova-compute[73091]:   <features>
Aug 16 08:17:56 user nova-compute[73091]:     <acpi/>
Aug 16 08:17:56 user nova-compute[73091]:     <apic/>
Aug 16 08:17:56 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:17:56 user nova-compute[73091]:   </features>
Aug 16 08:17:56 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:17:56 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:17:56 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:17:56 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:17:56 user nova-compute[73091]:   </clock>
Aug 16 08:17:56 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:17:56 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:17:56 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:17:56 user nova-compute[73091]:   </cpu>
Aug 16 08:17:56 user nova-compute[73091]:   <devices>
Aug 16 08:17:56 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:17:56 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:17:56 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk"/>
Aug 16 08:17:56 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:17:56 user nova-compute[73091]:     </disk>
Aug 16 08:17:56 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:17:56 user nova-compute[73091]:       <mac address="fa:16:3e:bf:58:1a"/>
Aug 16 08:17:56 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:17:56 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:17:56 user nova-compute[73091]:       <target dev="tap517d5e72-87"/>
Aug 16 08:17:56 user nova-compute[73091]:     </interface>
Aug 16 08:17:56 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:17:56 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/console.log" append="off"/>
Aug 16 08:17:56 user nova-compute[73091]:     </serial>
Aug 16 08:17:56 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:17:56 user nova-compute[73091]:     <video>
Aug 16 08:17:56 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:17:56 user nova-compute[73091]:     </video>
Aug 16 08:17:56 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:17:56 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:17:56 user nova-compute[73091]:     </rng>
Aug 16 08:17:56 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:17:56 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:17:56 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:17:56 user nova-compute[73091]:     </memballoon>
Aug 16 08:17:56 user nova-compute[73091]:   </devices>
Aug 16 08:17:56 user nova-compute[73091]: </domain>
Aug 16 08:17:56 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-570263048',display_name='tempest-TestStampPattern-server-570263048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-570263048',id=24,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjY6hgQa1AAGwykaBRcZc2nV+rEL8dDo+6sTGH8/byGV51hXtlwTwEczEaF87ayXTwpvU3ti3UJOIGlBUaU2Lfeh32bVYrEH/DNgzXWAcwYl53VOKHo1I7cthoxw0e5aw==',key_name='tempest-TestStampPattern-1619597978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f10cfd89a8bc47518de5a75998ab8ade',ramdisk_id='',reservation_id='r-mctfgeo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-472046926',owner_user_name='tempest-TestStampPattern-472046926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:17:53Z,user_data=None,user_id='46b5670aeead481cba521126a1fc8b49',uuid=4bfc7896-7001-48e3-a768-1030c3eb8485,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "address": "fa:16:3e:bf:58:1a", "network": {"id": "6beb82b7-1250-42a3-8a36-5c0eb0f52f8f", "bridge": "br-int", "label": "tempest-TestStampPattern-1309048302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10cfd89a8bc47518de5a75998ab8ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517d5e72-87", "ovs_interfaceid": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Converting VIF {"id": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "address": "fa:16:3e:bf:58:1a", "network": {"id": "6beb82b7-1250-42a3-8a36-5c0eb0f52f8f", "bridge": "br-int", "label": "tempest-TestStampPattern-1309048302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10cfd89a8bc47518de5a75998ab8ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517d5e72-87", "ovs_interfaceid": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:58:1a,bridge_name='br-int',has_traffic_filtering=True,id=517d5e72-8716-47bd-87b3-e61fcc3b1257,network=Network(6beb82b7-1250-42a3-8a36-5c0eb0f52f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap517d5e72-87') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG os_vif [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:58:1a,bridge_name='br-int',has_traffic_filtering=True,id=517d5e72-8716-47bd-87b3-e61fcc3b1257,network=Network(6beb82b7-1250-42a3-8a36-5c0eb0f52f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap517d5e72-87') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap517d5e72-87, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap517d5e72-87, col_values=(('external_ids', {'iface-id': '517d5e72-8716-47bd-87b3-e61fcc3b1257', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:58:1a', 'vm-uuid': '4bfc7896-7001-48e3-a768-1030c3eb8485'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:56 user nova-compute[73091]: INFO os_vif [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:58:1a,bridge_name='br-int',has_traffic_filtering=True,id=517d5e72-8716-47bd-87b3-e61fcc3b1257,network=Network(6beb82b7-1250-42a3-8a36-5c0eb0f52f8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap517d5e72-87')
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] No VIF found with MAC fa:16:3e:bf:58:1a, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-12be7193-4e7a-473f-a829-6a307ac80cdd req-63225437-25bf-46e9-8bbc-c421a1524a17 service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Received event network-changed-201fb9b8-9e2e-4088-8090-7840abedfdee {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.compute.manager [req-12be7193-4e7a-473f-a829-6a307ac80cdd req-63225437-25bf-46e9-8bbc-c421a1524a17 service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Refreshing instance network info cache due to event network-changed-201fb9b8-9e2e-4088-8090-7840abedfdee. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12be7193-4e7a-473f-a829-6a307ac80cdd req-63225437-25bf-46e9-8bbc-c421a1524a17 service nova] Acquiring lock "refresh_cache-a79098c3-784e-4315-8fd0-0ff883d4f6e3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12be7193-4e7a-473f-a829-6a307ac80cdd req-63225437-25bf-46e9-8bbc-c421a1524a17 service nova] Acquired lock "refresh_cache-a79098c3-784e-4315-8fd0-0ff883d4f6e3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-12be7193-4e7a-473f-a829-6a307ac80cdd req-63225437-25bf-46e9-8bbc-c421a1524a17 service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Refreshing network info cache for port 201fb9b8-9e2e-4088-8090-7840abedfdee {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-e5893edc-3300-447f-a32e-9fd409647992 req-e051dc55-6f6c-43a2-bd35-0b067f960c74 service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Updated VIF entry in instance network info cache for port 517d5e72-8716-47bd-87b3-e61fcc3b1257. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG nova.network.neutron [req-e5893edc-3300-447f-a32e-9fd409647992 req-e051dc55-6f6c-43a2-bd35-0b067f960c74 service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Updating instance_info_cache with network_info: [{"id": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "address": "fa:16:3e:bf:58:1a", "network": {"id": "6beb82b7-1250-42a3-8a36-5c0eb0f52f8f", "bridge": "br-int", "label": "tempest-TestStampPattern-1309048302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10cfd89a8bc47518de5a75998ab8ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517d5e72-87", "ovs_interfaceid": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:17:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e5893edc-3300-447f-a32e-9fd409647992 req-e051dc55-6f6c-43a2-bd35-0b067f960c74 service nova] Releasing lock "refresh_cache-4bfc7896-7001-48e3-a768-1030c3eb8485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-12be7193-4e7a-473f-a829-6a307ac80cdd req-63225437-25bf-46e9-8bbc-c421a1524a17 service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Updated VIF entry in instance network info cache for port 201fb9b8-9e2e-4088-8090-7840abedfdee. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG nova.network.neutron [req-12be7193-4e7a-473f-a829-6a307ac80cdd req-63225437-25bf-46e9-8bbc-c421a1524a17 service nova] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Updating instance_info_cache with network_info: [{"id": "201fb9b8-9e2e-4088-8090-7840abedfdee", "address": "fa:16:3e:bb:cf:90", "network": {"id": "1b4f840a-4ae4-4ec6-b69f-c6dcc5a07615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-590024824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262cfe8cedea4c91884fab18e18bc828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap201fb9b8-9e", "ovs_interfaceid": "201fb9b8-9e2e-4088-8090-7840abedfdee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-12be7193-4e7a-473f-a829-6a307ac80cdd req-63225437-25bf-46e9-8bbc-c421a1524a17 service nova] Releasing lock "refresh_cache-a79098c3-784e-4315-8fd0-0ff883d4f6e3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lazy-loading 'flavor' on Instance uuid a79098c3-784e-4315-8fd0-0ff883d4f6e3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:57 user nova-compute[73091]: INFO nova.compute.manager [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Attaching volume 787d3896-6e15-46ae-aa57-c119387ce0de to /dev/vdb
Aug 16 08:17:57 user nova-compute[73091]: DEBUG os_brick.utils [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbedd27a-d39b-4a7a-b1d0-031ea6eea02d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[685edcb1-5045-4e5b-ae1c-937f5b53df8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[126d8c58-5558-49f4-bb9e-cbd5c4c6f931]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e027d1e-73ae-4fef-95e5-f9f19ff43c05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:17:57 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:17:57 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93241a3-90a0-41e7-b680-711983859d7e]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG os_brick.utils [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Updating existing volume attachment record: 7cecd309-5679-4f54-893c-41acb0b42d05 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-96b2ed8a-0bc4-47f9-aab2-1bd0610ca64f req-9b12f147-9ded-4333-8a0a-2d5fed5413bb service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Received event network-vif-plugged-517d5e72-8716-47bd-87b3-e61fcc3b1257 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:17:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-96b2ed8a-0bc4-47f9-aab2-1bd0610ca64f req-9b12f147-9ded-4333-8a0a-2d5fed5413bb service nova] Acquiring lock "4bfc7896-7001-48e3-a768-1030c3eb8485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:17:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-96b2ed8a-0bc4-47f9-aab2-1bd0610ca64f req-9b12f147-9ded-4333-8a0a-2d5fed5413bb service nova] Lock "4bfc7896-7001-48e3-a768-1030c3eb8485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:17:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-96b2ed8a-0bc4-47f9-aab2-1bd0610ca64f req-9b12f147-9ded-4333-8a0a-2d5fed5413bb service nova] Lock "4bfc7896-7001-48e3-a768-1030c3eb8485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:17:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-96b2ed8a-0bc4-47f9-aab2-1bd0610ca64f req-9b12f147-9ded-4333-8a0a-2d5fed5413bb service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] No waiting events found dispatching network-vif-plugged-517d5e72-8716-47bd-87b3-e61fcc3b1257 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:17:58 user nova-compute[73091]: WARNING nova.compute.manager [req-96b2ed8a-0bc4-47f9-aab2-1bd0610ca64f req-9b12f147-9ded-4333-8a0a-2d5fed5413bb service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Received unexpected event network-vif-plugged-517d5e72-8716-47bd-87b3-e61fcc3b1257 for instance with vm_state building and task_state spawning.
Aug 16 08:17:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:17:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173880.1283963, 4bfc7896-7001-48e3-a768-1030c3eb8485 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:18:00 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] VM Resumed (Lifecycle Event)
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:18:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Instance spawned successfully.
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:18:00 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173880.136056, 4bfc7896-7001-48e3-a768-1030c3eb8485 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:18:00 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] VM Started (Lifecycle Event)
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-e77d7865-8ea9-4a63-88c3-865d19ce91c4 req-91043719-eff1-4d87-816c-90d58c741765 service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Received event network-vif-plugged-517d5e72-8716-47bd-87b3-e61fcc3b1257 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e77d7865-8ea9-4a63-88c3-865d19ce91c4 req-91043719-eff1-4d87-816c-90d58c741765 service nova] Acquiring lock "4bfc7896-7001-48e3-a768-1030c3eb8485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e77d7865-8ea9-4a63-88c3-865d19ce91c4 req-91043719-eff1-4d87-816c-90d58c741765 service nova] Lock "4bfc7896-7001-48e3-a768-1030c3eb8485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-e77d7865-8ea9-4a63-88c3-865d19ce91c4 req-91043719-eff1-4d87-816c-90d58c741765 service nova] Lock "4bfc7896-7001-48e3-a768-1030c3eb8485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-e77d7865-8ea9-4a63-88c3-865d19ce91c4 req-91043719-eff1-4d87-816c-90d58c741765 service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] No waiting events found dispatching network-vif-plugged-517d5e72-8716-47bd-87b3-e61fcc3b1257 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:18:00 user nova-compute[73091]: WARNING nova.compute.manager [req-e77d7865-8ea9-4a63-88c3-865d19ce91c4 req-91043719-eff1-4d87-816c-90d58c741765 service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Received unexpected event network-vif-plugged-517d5e72-8716-47bd-87b3-e61fcc3b1257 for instance with vm_state building and task_state spawning.
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:18:00 user nova-compute[73091]: INFO nova.compute.manager [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Took 6.95 seconds to spawn the instance on the hypervisor.
Aug 16 08:18:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:18:00 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:18:00 user nova-compute[73091]: INFO nova.compute.manager [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Took 7.90 seconds to build instance.
Aug 16 08:18:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-94648056-85af-424b-b4b4-6abf907a2058 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "4bfc7896-7001-48e3-a768-1030c3eb8485" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.009s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:06 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Acquiring lock "9a2dd138-1c20-4114-afac-e272aba39537" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "9a2dd138-1c20-4114-afac-e272aba39537" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:18:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:06 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:18:06 user nova-compute[73091]: INFO nova.compute.claims [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Claim successful on node user
Aug 16 08:18:07 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:18:07 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:18:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:18:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:18:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:18:07 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:18:07 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:18:07 user nova-compute[73091]: DEBUG nova.policy [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e76fe91d0ac44c0caf12d70bc2a1a0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7114778fe940f4a40e3bbc9e1330ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:18:07 user nova-compute[73091]: INFO nova.virt.block_device [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Booting with volume snapshot 580c80c7-23bc-41b5-a79a-88731524e04d at /dev/vda
Aug 16 08:18:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Successfully created port: 4dd5faac-d8ed-41ca-9160-c72beda8f636 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:18:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Successfully updated port: 4dd5faac-d8ed-41ca-9160-c72beda8f636 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:18:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Acquiring lock "refresh_cache-9a2dd138-1c20-4114-afac-e272aba39537" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:18:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Acquired lock "refresh_cache-9a2dd138-1c20-4114-afac-e272aba39537" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:18:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:18:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-f3bb99fb-5d0e-48d7-a72b-6a7667ed1e39 req-c868dd0c-b762-4ebf-a490-7f22b4566a81 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Received event network-changed-4dd5faac-d8ed-41ca-9160-c72beda8f636 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:09 user nova-compute[73091]: DEBUG nova.compute.manager [req-f3bb99fb-5d0e-48d7-a72b-6a7667ed1e39 req-c868dd0c-b762-4ebf-a490-7f22b4566a81 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Refreshing instance network info cache due to event network-changed-4dd5faac-d8ed-41ca-9160-c72beda8f636. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:18:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f3bb99fb-5d0e-48d7-a72b-6a7667ed1e39 req-c868dd0c-b762-4ebf-a490-7f22b4566a81 service nova] Acquiring lock "refresh_cache-9a2dd138-1c20-4114-afac-e272aba39537" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:18:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:18:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Updating instance_info_cache with network_info: [{"id": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "address": "fa:16:3e:8f:1a:51", "network": {"id": "cf1256b4-483b-4865-b7d3-66bdd6688483", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1119826949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7114778fe940f4a40e3bbc9e1330ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd5faac-d8", "ovs_interfaceid": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:18:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Releasing lock "refresh_cache-9a2dd138-1c20-4114-afac-e272aba39537" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:18:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Instance network_info: |[{"id": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "address": "fa:16:3e:8f:1a:51", "network": {"id": "cf1256b4-483b-4865-b7d3-66bdd6688483", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1119826949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7114778fe940f4a40e3bbc9e1330ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd5faac-d8", "ovs_interfaceid": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:18:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f3bb99fb-5d0e-48d7-a72b-6a7667ed1e39 req-c868dd0c-b762-4ebf-a490-7f22b4566a81 service nova] Acquired lock "refresh_cache-9a2dd138-1c20-4114-afac-e272aba39537" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:18:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-f3bb99fb-5d0e-48d7-a72b-6a7667ed1e39 req-c868dd0c-b762-4ebf-a490-7f22b4566a81 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Refreshing network info cache for port 4dd5faac-d8ed-41ca-9160-c72beda8f636 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:18:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-f3bb99fb-5d0e-48d7-a72b-6a7667ed1e39 req-c868dd0c-b762-4ebf-a490-7f22b4566a81 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Updated VIF entry in instance network info cache for port 4dd5faac-d8ed-41ca-9160-c72beda8f636. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:18:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-f3bb99fb-5d0e-48d7-a72b-6a7667ed1e39 req-c868dd0c-b762-4ebf-a490-7f22b4566a81 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Updating instance_info_cache with network_info: [{"id": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "address": "fa:16:3e:8f:1a:51", "network": {"id": "cf1256b4-483b-4865-b7d3-66bdd6688483", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1119826949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7114778fe940f4a40e3bbc9e1330ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd5faac-d8", "ovs_interfaceid": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:18:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-f3bb99fb-5d0e-48d7-a72b-6a7667ed1e39 req-c868dd0c-b762-4ebf-a490-7f22b4566a81 service nova] Releasing lock "refresh_cache-9a2dd138-1c20-4114-afac-e272aba39537" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:18:11 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:18:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "18850651-02ac-459a-838c-b3216bcbe131" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:15 user nova-compute[73091]: INFO nova.compute.manager [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Terminating instance
Aug 16 08:18:15 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 08:18:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:15 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-dd533188-76e5-4366-8ab4-97aeda0385c2 req-fad041d7-2acb-4de7-85c9-69dfcd51ab1b service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received event network-vif-unplugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dd533188-76e5-4366-8ab4-97aeda0385c2 req-fad041d7-2acb-4de7-85c9-69dfcd51ab1b service nova] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dd533188-76e5-4366-8ab4-97aeda0385c2 req-fad041d7-2acb-4de7-85c9-69dfcd51ab1b service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:15 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-dd533188-76e5-4366-8ab4-97aeda0385c2 req-fad041d7-2acb-4de7-85c9-69dfcd51ab1b service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-dd533188-76e5-4366-8ab4-97aeda0385c2 req-fad041d7-2acb-4de7-85c9-69dfcd51ab1b service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] No waiting events found dispatching network-vif-unplugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:18:15 user nova-compute[73091]: DEBUG nova.compute.manager [req-dd533188-76e5-4366-8ab4-97aeda0385c2 req-fad041d7-2acb-4de7-85c9-69dfcd51ab1b service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received event network-vif-unplugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Instance destroyed successfully.
Aug 16 08:18:16 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lazy-loading 'resources' on Instance uuid 18850651-02ac-459a-838c-b3216bcbe131 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T08:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1764805922',display_name='tempest-ServerActionsTestOtherA-server-652148951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1764805922',id=14,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz3j860Gkv1Slc5oyCWy6VoP7hKNPEjEuai3DW0jmBORKbAqdoKcQLb4MoAKfM8zJIG4wm2vu7GJkTGhorCXdn6cmATTCXJNllAcczoCXr4+3AVbBT7pCqZb5Uvu2XtIw==',key_name='tempest-keypair-502085907',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:14:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fc3a302cc78494296980753b56edb0c',ramdisk_id='',reservation_id='r-wmdyi2tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-534432070',owner_user_name='tempest-ServerActionsTestOtherA-534432070-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5a61e00249d4bc4b14dd0ab5b88e58c',uuid=18850651-02ac-459a-838c-b3216bcbe131,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converting VIF {"id": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "address": "fa:16:3e:99:72:46", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap439b29b8-64", "ovs_interfaceid": "439b29b8-64e3-40fe-b28b-0f8e05155ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:72:46,bridge_name='br-int',has_traffic_filtering=True,id=439b29b8-64e3-40fe-b28b-0f8e05155ab6,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap439b29b8-64') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG os_vif [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:72:46,bridge_name='br-int',has_traffic_filtering=True,id=439b29b8-64e3-40fe-b28b-0f8e05155ab6,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap439b29b8-64') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap439b29b8-64, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:16 user nova-compute[73091]: INFO os_vif [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:72:46,bridge_name='br-int',has_traffic_filtering=True,id=439b29b8-64e3-40fe-b28b-0f8e05155ab6,network=Network(fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap439b29b8-64')
Aug 16 08:18:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Deleting instance files /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131_del
Aug 16 08:18:16 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Deletion of /opt/stack/data/nova/instances/18850651-02ac-459a-838c-b3216bcbe131_del complete
Aug 16 08:18:16 user nova-compute[73091]: INFO nova.compute.manager [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 18850651-02ac-459a-838c-b3216bcbe131] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nhiZIezq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:18:16 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:18:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:18:16 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:18:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:18:16 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a120b7-8423-4ea1-a26d-7403645feaf6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:18:16 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d03da15-b017-4108-ac32-1c6d3a12d302]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de] added
Aug 16 08:18:16 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fc476e-e4a0-425a-a297-59d27b2f9263]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[681065ea-5e09-4816-8fda-77d340664151]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nhiZIezq {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nhiZIezq" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea0fe15-9119-4676-9ced-a74d26862f7a]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nhiZIezq'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:16 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3007594-bd27-4437-ba17-7e534b60bf30]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2476cf82-fcc4-4258-9450-b0fb8156d204]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:17 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:18:17 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:18:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:17 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:18:17 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:18:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78758b8-18c3-4901-bd5c-1af854732d7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de, portal: 172.16.0.220,3260]
Aug 16 08:18:17 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de, portal: 172.16.0.220,3260] successful.
Aug 16 08:18:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[866da687-ae98-492b-b405-e107dcff428e]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6e444f-3479-4d01-9e33-71ca82f2f89f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:17 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:18:17 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:18:17 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:17 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:18:17 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:18:17 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:17 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb8e1b9-9991-4c09-a441-df0fb17ff646]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:18:17 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Took 0.89 seconds to deallocate network for instance.
Aug 16 08:18:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-6cc000d1-c0dd-45db-9146-d689b0346c2a req-45b53e08-9727-4d2a-85b0-3a260ec87535 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received event network-vif-deleted-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-274caf5c-3817-499f-a728-fd85c0a3c190 req-64e7b193-3eb2-4581-a803-da1b3b27d142 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received event network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-274caf5c-3817-499f-a728-fd85c0a3c190 req-64e7b193-3eb2-4581-a803-da1b3b27d142 service nova] Acquiring lock "18850651-02ac-459a-838c-b3216bcbe131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-274caf5c-3817-499f-a728-fd85c0a3c190 req-64e7b193-3eb2-4581-a803-da1b3b27d142 service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-274caf5c-3817-499f-a728-fd85c0a3c190 req-64e7b193-3eb2-4581-a803-da1b3b27d142 service nova] Lock "18850651-02ac-459a-838c-b3216bcbe131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:17 user nova-compute[73091]: DEBUG nova.compute.manager [req-274caf5c-3817-499f-a728-fd85c0a3c190 req-64e7b193-3eb2-4581-a803-da1b3b27d142 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] No waiting events found dispatching network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:18:17 user nova-compute[73091]: WARNING nova.compute.manager [req-274caf5c-3817-499f-a728-fd85c0a3c190 req-64e7b193-3eb2-4581-a803-da1b3b27d142 service nova] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Received unexpected event network-vif-plugged-439b29b8-64e3-40fe-b28b-0f8e05155ab6 for instance with vm_state deleted and task_state None.
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:18 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Deleted allocations for instance 18850651-02ac-459a-838c-b3216bcbe131
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cdebacad-6468-46c2-8720-93fe3c5110ef tempest-ServerActionsTestOtherA-534432070 tempest-ServerActionsTestOtherA-534432070-project-member] Lock "18850651-02ac-459a-838c-b3216bcbe131" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.490s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nhiZIezq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23562623137613866', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562623137613866', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG nova.objects.instance [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lazy-loading 'flavor' on Instance uuid a79098c3-784e-4315-8fd0-0ff883d4f6e3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 08:18:18 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:18:18 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 08:18:18 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:18:18 user nova-compute[73091]:   <serial>787d3896-6e15-46ae-aa57-c119387ce0de</serial>
Aug 16 08:18:18 user nova-compute[73091]: </disk>
Aug 16 08:18:18 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG os_brick.utils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b511d0-7594-43b2-8e80-c7af009fbf5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e65c52-c0a0-419b-a2dc-5d2f0ebbb87b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[777b3de4-5452-4943-8f5b-e398fa229de4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[574e7b42-a200-4c44-8063-49b2de202dbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:18:18 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[356a75c4-1b45-48a3-b29c-1f842fcc8905]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG os_brick.utils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Updating existing volume attachment record: 3302c00b-92ee-4e1d-812d-964beab276ea {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] No VIF found with MAC fa:16:3e:bb:cf:90, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-3e70825a-8b0c-455d-9427-fb5161145f11 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.180s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "476de8ea-30dd-4b52-be37-f134e445757f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:18 user nova-compute[73091]: INFO nova.compute.manager [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Terminating instance
Aug 16 08:18:18 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Instance destroyed successfully.
Aug 16 08:18:19 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lazy-loading 'resources' on Instance uuid 476de8ea-30dd-4b52-be37-f134e445757f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1087600235',display_name='tempest-ServerActionsTestOtherB-server-1087600235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1087600235',id=5,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYOKpfDgZmCpH8NYnZIDX4Q6r6QSrYp8+9Ju9pcp2BTpCW6+zgtRofh+/Nl5vfXB2jjGRnF27mUoD5eGzz9iJpQmGeAh8YbRVeP6cdUfPheYKUhiI9ogz9BCberiIkZFg==',key_name='tempest-keypair-657367706',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:15:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec0498ad9dc84c56ad076bae8fd158a8',ramdisk_id='',reservation_id='r-wwzf0so4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1828527690',owner_user_name='tempest-ServerActionsTestOtherB-1828527690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:15:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18882b1744742dbb0b5d157aed696a1',uuid=476de8ea-30dd-4b52-be37-f134e445757f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converting VIF {"id": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "address": "fa:16:3e:58:35:e3", "network": {"id": "4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1821957046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec0498ad9dc84c56ad076bae8fd158a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1acfd5b5-3a", "ovs_interfaceid": "1acfd5b5-3ae9-44d0-822d-7382be3fd551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_vif [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1acfd5b5-3a, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:19 user nova-compute[73091]: INFO os_vif [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:35:e3,bridge_name='br-int',has_traffic_filtering=True,id=1acfd5b5-3ae9-44d0-822d-7382be3fd551,network=Network(4aa7a8dc-fdf0-4e53-ab0a-0a92ec1d349d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1acfd5b5-3a')
Aug 16 08:18:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQVAUtDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:18:19 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e29944-4616-45ce-bf1b-3c9f65d9c764]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a080ca-f164-4542-9048-a261eec17555]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:19 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:18:19 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:18:19 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:19 user nova-compute[73091]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c (non-flash)
Aug 16 08:18:19 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:18:19 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb904a0cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5d8d95-ec15-456f-929c-6e0a895b8f15]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cef9e2d-b5ff-4197-aa6e-bfe7ea895bda]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a216d2-146c-451f-8f1b-b9376fcd281a]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ee22ce-7ad1-430f-9276-e9baf63ef855]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e118d1a-b7a6-49b4-8c91-93ffc89dbb52]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3633fe-6d67-4f3f-b606-a2664cffb891]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260]
Aug 16 08:18:19 user nova-compute[73091]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c, portal: 172.16.0.220,3260] successful.
Aug 16 08:18:19 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f37e5a8-0be3-43d7-bff6-390364c5e37c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a292c768-e163-4efe-931d-3fef34d12d3c]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] <== disconnect_volume: return (278ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:18:19 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:18:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Deleting instance files /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f_del
Aug 16 08:18:19 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Deletion of /opt/stack/data/nova/instances/476de8ea-30dd-4b52-be37-f134e445757f_del complete
Aug 16 08:18:20 user nova-compute[73091]: INFO nova.compute.manager [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 16 08:18:20 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 08:18:20 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 08:18:20 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 08:18:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-a8f2beee-d982-40a7-885d-2c2ee00cdeea req-b1a2192f-b33a-4ca5-8f6d-b235666b4fac service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-vif-unplugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8f2beee-d982-40a7-885d-2c2ee00cdeea req-b1a2192f-b33a-4ca5-8f6d-b235666b4fac service nova] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8f2beee-d982-40a7-885d-2c2ee00cdeea req-b1a2192f-b33a-4ca5-8f6d-b235666b4fac service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8f2beee-d982-40a7-885d-2c2ee00cdeea req-b1a2192f-b33a-4ca5-8f6d-b235666b4fac service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-a8f2beee-d982-40a7-885d-2c2ee00cdeea req-b1a2192f-b33a-4ca5-8f6d-b235666b4fac service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] No waiting events found dispatching network-vif-unplugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:18:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-a8f2beee-d982-40a7-885d-2c2ee00cdeea req-b1a2192f-b33a-4ca5-8f6d-b235666b4fac service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-vif-unplugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:18:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-a8f2beee-d982-40a7-885d-2c2ee00cdeea req-b1a2192f-b33a-4ca5-8f6d-b235666b4fac service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8f2beee-d982-40a7-885d-2c2ee00cdeea req-b1a2192f-b33a-4ca5-8f6d-b235666b4fac service nova] Acquiring lock "476de8ea-30dd-4b52-be37-f134e445757f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8f2beee-d982-40a7-885d-2c2ee00cdeea req-b1a2192f-b33a-4ca5-8f6d-b235666b4fac service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:20 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-a8f2beee-d982-40a7-885d-2c2ee00cdeea req-b1a2192f-b33a-4ca5-8f6d-b235666b4fac service nova] Lock "476de8ea-30dd-4b52-be37-f134e445757f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:20 user nova-compute[73091]: DEBUG nova.compute.manager [req-a8f2beee-d982-40a7-885d-2c2ee00cdeea req-b1a2192f-b33a-4ca5-8f6d-b235666b4fac service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] No waiting events found dispatching network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:18:20 user nova-compute[73091]: WARNING nova.compute.manager [req-a8f2beee-d982-40a7-885d-2c2ee00cdeea req-b1a2192f-b33a-4ca5-8f6d-b235666b4fac service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received unexpected event network-vif-plugged-1acfd5b5-3ae9-44d0-822d-7382be3fd551 for instance with vm_state active and task_state deleting.
Aug 16 08:18:21 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:18:21 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Took 1.53 seconds to deallocate network for instance.
Aug 16 08:18:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-a1850d5d-a4db-4ba8-8129-c3040feb1c50 req-38d7aae8-7161-4a8c-adfd-16bfb3d339cb service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Received event network-vif-deleted-1acfd5b5-3ae9-44d0-822d-7382be3fd551 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:21 user nova-compute[73091]: INFO nova.compute.manager [req-a1850d5d-a4db-4ba8-8129-c3040feb1c50 req-38d7aae8-7161-4a8c-adfd-16bfb3d339cb service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Neutron deleted interface 1acfd5b5-3ae9-44d0-822d-7382be3fd551; detaching it from the instance and deleting it from the info cache
Aug 16 08:18:21 user nova-compute[73091]: DEBUG nova.network.neutron [req-a1850d5d-a4db-4ba8-8129-c3040feb1c50 req-38d7aae8-7161-4a8c-adfd-16bfb3d339cb service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:18:21 user nova-compute[73091]: DEBUG nova.compute.manager [req-a1850d5d-a4db-4ba8-8129-c3040feb1c50 req-38d7aae8-7161-4a8c-adfd-16bfb3d339cb service nova] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Detach interface failed, port_id=1acfd5b5-3ae9-44d0-822d-7382be3fd551, reason: Instance 476de8ea-30dd-4b52-be37-f134e445757f could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 08:18:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:21 user nova-compute[73091]: DEBUG nova.objects.instance [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lazy-loading 'flavor' on Instance uuid a79098c3-784e-4315-8fd0-0ff883d4f6e3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:18:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:21 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:21 user nova-compute[73091]: INFO nova.compute.manager [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Attaching volume 0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 to /dev/vdc
Aug 16 08:18:22 user nova-compute[73091]: DEBUG os_brick.utils [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[16912fcf-8fc4-4cf5-8fa0-3ccdaf2395d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31a9a57-5cb9-43fd-9fff-d2e1ef418e9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a0a791-92ae-4d46-b032-09e62cc98098]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbec87a8-acaa-4a76-a969-3fe91b96505a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:18:22 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d9b6e1-1977-4264-8252-8188d176200a]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG os_brick.utils [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Updating existing volume attachment record: 061aeca2-d047-40e0-a4af-df664dca3e72 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:18:22 user nova-compute[73091]: INFO nova.compute.manager [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Took 0.85 seconds to detach 1 volumes for instance.
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:18:22 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:23 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Deleted allocations for instance 476de8ea-30dd-4b52-be37-f134e445757f
Aug 16 08:18:23 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8512b360-9c21-477d-8b83-b89480e147cb tempest-ServerActionsTestOtherB-1828527690 tempest-ServerActionsTestOtherB-1828527690-project-member] Lock "476de8ea-30dd-4b52-be37-f134e445757f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.257s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:24 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:18:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:24 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:18:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:18:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:18:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquired lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:18:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 08:18:25 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Updating instance_info_cache with network_info: [{"id": "a8445f80-1201-4794-b715-36e357399997", "address": "fa:16:3e:d2:ee:e5", "network": {"id": "fc1b7dc0-2c2c-4033-8b66-f95abd2f60dd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1277600547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc3a302cc78494296980753b56edb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8445f80-12", "ovs_interfaceid": "a8445f80-1201-4794-b715-36e357399997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:18:25 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Releasing lock "refresh_cache-daf2b789-eba2-419b-99f6-be8f483151ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:18:25 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: daf2b789-eba2-419b-99f6-be8f483151ba] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 08:18:25 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-0a948fa5-c770-47f9-8dfe-5240f9b7b465 req-77add6e7-58be-4c75-bcdf-32475063031c service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Received event network-changed-f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG nova.compute.manager [req-0a948fa5-c770-47f9-8dfe-5240f9b7b465 req-77add6e7-58be-4c75-bcdf-32475063031c service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Refreshing instance network info cache due to event network-changed-f9eb011a-7d5c-4be9-b942-892f3bd8da61. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0a948fa5-c770-47f9-8dfe-5240f9b7b465 req-77add6e7-58be-4c75-bcdf-32475063031c service nova] Acquiring lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0a948fa5-c770-47f9-8dfe-5240f9b7b465 req-77add6e7-58be-4c75-bcdf-32475063031c service nova] Acquired lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG nova.network.neutron [req-0a948fa5-c770-47f9-8dfe-5240f9b7b465 req-77add6e7-58be-4c75-bcdf-32475063031c service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Refreshing network info cache for port f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:18:26 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Acquiring lock "b989d006-e422-41eb-94f4-69667f2c26fe" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "b989d006-e422-41eb-94f4-69667f2c26fe" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:27 user nova-compute[73091]: INFO nova.compute.manager [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Shelve offloading
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-0a948fa5-c770-47f9-8dfe-5240f9b7b465 req-77add6e7-58be-4c75-bcdf-32475063031c service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Updated VIF entry in instance network info cache for port f9eb011a-7d5c-4be9-b942-892f3bd8da61. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG nova.network.neutron [req-0a948fa5-c770-47f9-8dfe-5240f9b7b465 req-77add6e7-58be-4c75-bcdf-32475063031c service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Updating instance_info_cache with network_info: [{"id": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "address": "fa:16:3e:05:a5:99", "network": {"id": "a4adecd1-dbe1-4cef-917c-522e65d07da7", "bridge": "br-int", "label": "tempest-TestShelveInstance-933324279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48441e65eff8478f9a562b9cec17af11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9eb011a-7d", "ovs_interfaceid": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-0a948fa5-c770-47f9-8dfe-5240f9b7b465 req-77add6e7-58be-4c75-bcdf-32475063031c service nova] Releasing lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-67a47f93-efa5-4fc7-9c77-18067c04361b req-f703de86-23f1-460c-97e5-0a190a79c66e service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Received event network-vif-unplugged-f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67a47f93-efa5-4fc7-9c77-18067c04361b req-f703de86-23f1-460c-97e5-0a190a79c66e service nova] Acquiring lock "b989d006-e422-41eb-94f4-69667f2c26fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67a47f93-efa5-4fc7-9c77-18067c04361b req-f703de86-23f1-460c-97e5-0a190a79c66e service nova] Lock "b989d006-e422-41eb-94f4-69667f2c26fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-67a47f93-efa5-4fc7-9c77-18067c04361b req-f703de86-23f1-460c-97e5-0a190a79c66e service nova] Lock "b989d006-e422-41eb-94f4-69667f2c26fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:27 user nova-compute[73091]: DEBUG nova.compute.manager [req-67a47f93-efa5-4fc7-9c77-18067c04361b req-f703de86-23f1-460c-97e5-0a190a79c66e service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] No waiting events found dispatching network-vif-unplugged-f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:18:27 user nova-compute[73091]: WARNING nova.compute.manager [req-67a47f93-efa5-4fc7-9c77-18067c04361b req-f703de86-23f1-460c-97e5-0a190a79c66e service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Received unexpected event network-vif-unplugged-f9eb011a-7d5c-4be9-b942-892f3bd8da61 for instance with vm_state active and task_state shelving.
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:18:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Creating image(s)
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Did not create local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Ensure instance console log exists: /opt/stack/data/nova/instances/9a2dd138-1c20-4114-afac-e272aba39537/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Start _get_guest_xml network_info=[{"id": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "address": "fa:16:3e:8f:1a:51", "network": {"id": "cf1256b4-483b-4865-b7d3-66bdd6688483", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1119826949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7114778fe940f4a40e3bbc9e1330ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd5faac-d8", "ovs_interfaceid": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '3302c00b-92ee-4e1d-812d-964beab276ea', 'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFneqohD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a2dd138-1c20-4114-afac-e272aba39537', 'attached_at': '', 'detached_at': '', 'volume_id': '4d4c5143-c649-4a19-9aea-9189ea42c65d', 'serial': '4d4c5143-c649-4a19-9aea-9189ea42c65d'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:18:28 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:18:28 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:18:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Instance destroyed successfully.
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFneqohD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:18:28 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:18:28 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:18:28 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Acquiring lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Acquired lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[42efc2a4-5d3d-4946-9fa3-df2ae12a03cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:18:28 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b269c374-df34-458d-9e05-03e979baf612]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d] added
Aug 16 08:18:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6869d11c-1569-425c-8203-5e58aff0902c]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[30181b93-0369-4d80-804e-86a723211b64]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AFneqohD {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AFneqohD" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e53231-5241-4662-969a-fab84b3c4105]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AFneqohD'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea8af00-e940-443f-8887-fe46695e5871]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f80279a-c414-4eff-bfca-384676cf2602]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:28 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:18:28 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:28 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:18:28 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec01bb7-6255-4717-aefd-0c9bda020691]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d, portal: 172.16.0.220,3260]
Aug 16 08:18:28 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d, portal: 172.16.0.220,3260] successful.
Aug 16 08:18:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[06af1408-9c6d-45b3-98e4-f5b2294f6f77]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[613730b7-4067-41b1-bb41-171a6c0d7959]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:28 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:18:28 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:28 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:18:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:28 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:18:28 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:28 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:18:28 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3516b508-9a37-4073-8f75-10e160a82d37]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG nova.network.neutron [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Updating instance_info_cache with network_info: [{"id": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "address": "fa:16:3e:05:a5:99", "network": {"id": "a4adecd1-dbe1-4cef-917c-522e65d07da7", "bridge": "br-int", "label": "tempest-TestShelveInstance-933324279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48441e65eff8478f9a562b9cec17af11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9eb011a-7d", "ovs_interfaceid": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:18:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Releasing lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Instance destroyed successfully.
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lazy-loading 'resources' on Instance uuid b989d006-e422-41eb-94f4-69667f2c26fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-961399317',display_name='tempest-TestShelveInstance-server-961399317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-961399317',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgCoqmOvVcPifa6WcPHvVV74vDspI2ASN1zTG+1XaqND59EL2J0UY3jvMAI1AEhjXS4HzPZpW603j2VSgtwNn3AQLnzBif2nEywZ5psXdMgHmCL1JCS6FjtY0a5L1ZsLA==',key_name='tempest-TestShelveInstance-1740614777',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48441e65eff8478f9a562b9cec17af11',ramdisk_id='',reservation_id='r-yq99aynu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-404090758',owner_user_name='tempest-TestShelveInstance-404090758-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:16:52Z,user_data=None,user_id='24b833578e0341aab439f8a2f611d3b3',uuid=b989d006-e422-41eb-94f4-69667f2c26fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "address": "fa:16:3e:05:a5:99", "network": {"id": "a4adecd1-dbe1-4cef-917c-522e65d07da7", "bridge": "br-int", "label": "tempest-TestShelveInstance-933324279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48441e65eff8478f9a562b9cec17af11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9eb011a-7d", "ovs_interfaceid": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Converting VIF {"id": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "address": "fa:16:3e:05:a5:99", "network": {"id": "a4adecd1-dbe1-4cef-917c-522e65d07da7", "bridge": "br-int", "label": "tempest-TestShelveInstance-933324279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48441e65eff8478f9a562b9cec17af11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9eb011a-7d", "ovs_interfaceid": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:a5:99,bridge_name='br-int',has_traffic_filtering=True,id=f9eb011a-7d5c-4be9-b942-892f3bd8da61,network=Network(a4adecd1-dbe1-4cef-917c-522e65d07da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9eb011a-7d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_vif [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:a5:99,bridge_name='br-int',has_traffic_filtering=True,id=f9eb011a-7d5c-4be9-b942-892f3bd8da61,network=Network(a4adecd1-dbe1-4cef-917c-522e65d07da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9eb011a-7d') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9eb011a-7d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:18:29 user nova-compute[73091]: INFO os_vif [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:a5:99,bridge_name='br-int',has_traffic_filtering=True,id=f9eb011a-7d5c-4be9-b942-892f3bd8da61,network=Network(a4adecd1-dbe1-4cef-917c-522e65d07da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9eb011a-7d')
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RwUNVltE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:18:29 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFneqohD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '23235666264636361', 'path': '/dev/sdd'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235666264636361', 'path': '/dev/sdd'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.113s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b101df65-cc52-4685-8ed9-b05b5df3a803]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1726819447',display_name='tempest-TestVolumeBootPattern-server-1726819447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1726819447',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7114778fe940f4a40e3bbc9e1330ee',ramdisk_id='',reservation_id='r-n8h0zek0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1306800265',owner_user_name='tempest-TestVolumeBootPattern-1306800265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:18:08Z,user_data=None,user_id='e76fe91d0ac44c0caf12d70bc2a1a0f6',uuid=9a2dd138-1c20-4114-afac-e272aba39537,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "address": "fa:16:3e:8f:1a:51", "network": {"id": "cf1256b4-483b-4865-b7d3-66bdd6688483", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1119826949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7114778fe940f4a40e3bbc9e1330ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd5faac-d8", "ovs_interfaceid": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Converting VIF {"id": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "address": "fa:16:3e:8f:1a:51", "network": {"id": "cf1256b4-483b-4865-b7d3-66bdd6688483", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1119826949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7114778fe940f4a40e3bbc9e1330ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd5faac-d8", "ovs_interfaceid": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=4dd5faac-d8ed-41ca-9160-c72beda8f636,network=Network(cf1256b4-483b-4865-b7d3-66bdd6688483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dd5faac-d8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a2dd138-1c20-4114-afac-e272aba39537 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:18:29 user nova-compute[73091]:   <uuid>9a2dd138-1c20-4114-afac-e272aba39537</uuid>
Aug 16 08:18:29 user nova-compute[73091]:   <name>instance-00000019</name>
Aug 16 08:18:29 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:18:29 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:18:29 user nova-compute[73091]:   <metadata>
Aug 16 08:18:29 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:18:29 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:18:29 user nova-compute[73091]:       <nova:name>tempest-TestVolumeBootPattern-server-1726819447</nova:name>
Aug 16 08:18:29 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:18:28</nova:creationTime>
Aug 16 08:18:29 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:18:29 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:18:29 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:18:29 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:18:29 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:18:29 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:18:29 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:18:29 user nova-compute[73091]:       <nova:owner>
Aug 16 08:18:29 user nova-compute[73091]:         <nova:user uuid="e76fe91d0ac44c0caf12d70bc2a1a0f6">tempest-TestVolumeBootPattern-1306800265-project-member</nova:user>
Aug 16 08:18:29 user nova-compute[73091]:         <nova:project uuid="fe7114778fe940f4a40e3bbc9e1330ee">tempest-TestVolumeBootPattern-1306800265</nova:project>
Aug 16 08:18:29 user nova-compute[73091]:       </nova:owner>
Aug 16 08:18:29 user nova-compute[73091]:       <nova:ports>
Aug 16 08:18:29 user nova-compute[73091]:         <nova:port uuid="4dd5faac-d8ed-41ca-9160-c72beda8f636">
Aug 16 08:18:29 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 08:18:29 user nova-compute[73091]:         </nova:port>
Aug 16 08:18:29 user nova-compute[73091]:       </nova:ports>
Aug 16 08:18:29 user nova-compute[73091]:     </nova:instance>
Aug 16 08:18:29 user nova-compute[73091]:   </metadata>
Aug 16 08:18:29 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:18:29 user nova-compute[73091]:     <system>
Aug 16 08:18:29 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:18:29 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:18:29 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:18:29 user nova-compute[73091]:       <entry name="serial">9a2dd138-1c20-4114-afac-e272aba39537</entry>
Aug 16 08:18:29 user nova-compute[73091]:       <entry name="uuid">9a2dd138-1c20-4114-afac-e272aba39537</entry>
Aug 16 08:18:29 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:18:29 user nova-compute[73091]:     </system>
Aug 16 08:18:29 user nova-compute[73091]:   </sysinfo>
Aug 16 08:18:29 user nova-compute[73091]:   <os>
Aug 16 08:18:29 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:18:29 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:18:29 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:18:29 user nova-compute[73091]:   </os>
Aug 16 08:18:29 user nova-compute[73091]:   <features>
Aug 16 08:18:29 user nova-compute[73091]:     <acpi/>
Aug 16 08:18:29 user nova-compute[73091]:     <apic/>
Aug 16 08:18:29 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:18:29 user nova-compute[73091]:   </features>
Aug 16 08:18:29 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:18:29 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:18:29 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:18:29 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:18:29 user nova-compute[73091]:   </clock>
Aug 16 08:18:29 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:18:29 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:18:29 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:18:29 user nova-compute[73091]:   </cpu>
Aug 16 08:18:29 user nova-compute[73091]:   <devices>
Aug 16 08:18:29 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:18:29 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:18:29 user nova-compute[73091]:       <source dev="/dev/sdd"/>
Aug 16 08:18:29 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:18:29 user nova-compute[73091]:       <serial>4d4c5143-c649-4a19-9aea-9189ea42c65d</serial>
Aug 16 08:18:29 user nova-compute[73091]:     </disk>
Aug 16 08:18:29 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:18:29 user nova-compute[73091]:       <mac address="fa:16:3e:8f:1a:51"/>
Aug 16 08:18:29 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:18:29 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:18:29 user nova-compute[73091]:       <target dev="tap4dd5faac-d8"/>
Aug 16 08:18:29 user nova-compute[73091]:     </interface>
Aug 16 08:18:29 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:18:29 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/9a2dd138-1c20-4114-afac-e272aba39537/console.log" append="off"/>
Aug 16 08:18:29 user nova-compute[73091]:     </serial>
Aug 16 08:18:29 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:18:29 user nova-compute[73091]:     <video>
Aug 16 08:18:29 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:18:29 user nova-compute[73091]:     </video>
Aug 16 08:18:29 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:18:29 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:18:29 user nova-compute[73091]:     </rng>
Aug 16 08:18:29 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:18:29 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:18:29 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:18:29 user nova-compute[73091]:     </memballoon>
Aug 16 08:18:29 user nova-compute[73091]:   </devices>
Aug 16 08:18:29 user nova-compute[73091]: </domain>
Aug 16 08:18:29 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1726819447',display_name='tempest-TestVolumeBootPattern-server-1726819447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1726819447',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7114778fe940f4a40e3bbc9e1330ee',ramdisk_id='',reservation_id='r-n8h0zek0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1306800265',owner_user_name='tempest-TestVolumeBootPattern-1306800265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:18:08Z,user_data=None,user_id='e76fe91d0ac44c0caf12d70bc2a1a0f6',uuid=9a2dd138-1c20-4114-afac-e272aba39537,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "address": "fa:16:3e:8f:1a:51", "network": {"id": "cf1256b4-483b-4865-b7d3-66bdd6688483", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1119826949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7114778fe940f4a40e3bbc9e1330ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd5faac-d8", "ovs_interfaceid": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Converting VIF {"id": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "address": "fa:16:3e:8f:1a:51", "network": {"id": "cf1256b4-483b-4865-b7d3-66bdd6688483", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1119826949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7114778fe940f4a40e3bbc9e1330ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd5faac-d8", "ovs_interfaceid": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=4dd5faac-d8ed-41ca-9160-c72beda8f636,network=Network(cf1256b4-483b-4865-b7d3-66bdd6688483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dd5faac-d8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_vif [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=4dd5faac-d8ed-41ca-9160-c72beda8f636,network=Network(cf1256b4-483b-4865-b7d3-66bdd6688483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dd5faac-d8') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd29931-9754-4736-be98-d822a6fcfd75]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:29 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:18:29 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:29 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:18:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:29 user nova-compute[73091]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 (non-flash)
Aug 16 08:18:29 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:29 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:18:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8cc58ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Removing single pathed devices sdf {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dd5faac-d8, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4dd5faac-d8, col_values=(('external_ids', {'iface-id': '4dd5faac-d8ed-41ca-9160-c72beda8f636', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:1a:51', 'vm-uuid': '9a2dd138-1c20-4114-afac-e272aba39537'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:29 user nova-compute[73091]: INFO os_vif [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=4dd5faac-d8ed-41ca-9160-c72beda8f636,network=Network(cf1256b4-483b-4865-b7d3-66bdd6688483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dd5faac-d8')
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2fc015-62a6-4893-b50d-b7bffab096f2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3295e591-6025-48ad-95cf-2ff8fdadf7c8]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1debd868-dd96-4f44-b609-6f68ea93694a]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:18:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-5bc556fa-4090-4361-a1ae-2f96efc7d48d req-526a9f74-3b79-4af3-a813-b86367f7b311 service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Received event network-vif-plugged-f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5bc556fa-4090-4361-a1ae-2f96efc7d48d req-526a9f74-3b79-4af3-a813-b86367f7b311 service nova] Acquiring lock "b989d006-e422-41eb-94f4-69667f2c26fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5bc556fa-4090-4361-a1ae-2f96efc7d48d req-526a9f74-3b79-4af3-a813-b86367f7b311 service nova] Lock "b989d006-e422-41eb-94f4-69667f2c26fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5bc556fa-4090-4361-a1ae-2f96efc7d48d req-526a9f74-3b79-4af3-a813-b86367f7b311 service nova] Lock "b989d006-e422-41eb-94f4-69667f2c26fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-5bc556fa-4090-4361-a1ae-2f96efc7d48d req-526a9f74-3b79-4af3-a813-b86367f7b311 service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] No waiting events found dispatching network-vif-plugged-f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:18:30 user nova-compute[73091]: WARNING nova.compute.manager [req-5bc556fa-4090-4361-a1ae-2f96efc7d48d req-526a9f74-3b79-4af3-a813-b86367f7b311 service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Received unexpected event network-vif-plugged-f9eb011a-7d5c-4be9-b942-892f3bd8da61 for instance with vm_state active and task_state shelving.
Aug 16 08:18:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-5bc556fa-4090-4361-a1ae-2f96efc7d48d req-526a9f74-3b79-4af3-a813-b86367f7b311 service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Received event network-changed-f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG nova.compute.manager [req-5bc556fa-4090-4361-a1ae-2f96efc7d48d req-526a9f74-3b79-4af3-a813-b86367f7b311 service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Refreshing instance network info cache due to event network-changed-f9eb011a-7d5c-4be9-b942-892f3bd8da61. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5bc556fa-4090-4361-a1ae-2f96efc7d48d req-526a9f74-3b79-4af3-a813-b86367f7b311 service nova] Acquiring lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5bc556fa-4090-4361-a1ae-2f96efc7d48d req-526a9f74-3b79-4af3-a813-b86367f7b311 service nova] Acquired lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-5bc556fa-4090-4361-a1ae-2f96efc7d48d req-526a9f74-3b79-4af3-a813-b86367f7b311 service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Refreshing network info cache for port f9eb011a-7d5c-4be9-b942-892f3bd8da61 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b2e835-9249-43d0-a400-2f03dadf56f0]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6da01e5-2324-4628-a9a1-c214363b3273]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] No VIF found with MAC fa:16:3e:8f:1a:51, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b957370-e03b-492e-9c33-e0ca6cb75a3d]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992, portal: 172.16.0.220,3260]
Aug 16 08:18:30 user nova-compute[73091]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992, portal: 172.16.0.220,3260] successful.
Aug 16 08:18:30 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a81fcd58-6d6c-4192-abcc-e8a0f4a48992 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[68812c3a-cbb7-45b2-87da-458b86859c8f]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] <== disconnect_volume: return (455ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:18:30 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Deleting instance files /opt/stack/data/nova/instances/b989d006-e422-41eb-94f4-69667f2c26fe_del
Aug 16 08:18:30 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Deletion of /opt/stack/data/nova/instances/b989d006-e422-41eb-94f4-69667f2c26fe_del complete
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-5bc556fa-4090-4361-a1ae-2f96efc7d48d req-526a9f74-3b79-4af3-a813-b86367f7b311 service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Updated VIF entry in instance network info cache for port f9eb011a-7d5c-4be9-b942-892f3bd8da61. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG nova.network.neutron [req-5bc556fa-4090-4361-a1ae-2f96efc7d48d req-526a9f74-3b79-4af3-a813-b86367f7b311 service nova] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Updating instance_info_cache with network_info: [{"id": "f9eb011a-7d5c-4be9-b942-892f3bd8da61", "address": "fa:16:3e:05:a5:99", "network": {"id": "a4adecd1-dbe1-4cef-917c-522e65d07da7", "bridge": null, "label": "tempest-TestShelveInstance-933324279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48441e65eff8478f9a562b9cec17af11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf9eb011a-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5bc556fa-4090-4361-a1ae-2f96efc7d48d req-526a9f74-3b79-4af3-a813-b86367f7b311 service nova] Releasing lock "refresh_cache-b989d006-e422-41eb-94f4-69667f2c26fe" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:31 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:31 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Deleted allocations for instance b989d006-e422-41eb-94f4-69667f2c26fe
Aug 16 08:18:32 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173896.4447324, 18850651-02ac-459a-838c-b3216bcbe131 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:18:32 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 18850651-02ac-459a-838c-b3216bcbe131] VM Stopped (Lifecycle Event)
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-5084fb58-cee7-44ee-aec9-35cfb215026b req-c052c0cd-a1a2-47b7-939c-d30437ea3e01 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Received event network-vif-plugged-4dd5faac-d8ed-41ca-9160-c72beda8f636 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5084fb58-cee7-44ee-aec9-35cfb215026b req-c052c0cd-a1a2-47b7-939c-d30437ea3e01 service nova] Acquiring lock "9a2dd138-1c20-4114-afac-e272aba39537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5084fb58-cee7-44ee-aec9-35cfb215026b req-c052c0cd-a1a2-47b7-939c-d30437ea3e01 service nova] Lock "9a2dd138-1c20-4114-afac-e272aba39537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5084fb58-cee7-44ee-aec9-35cfb215026b req-c052c0cd-a1a2-47b7-939c-d30437ea3e01 service nova] Lock "9a2dd138-1c20-4114-afac-e272aba39537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-5084fb58-cee7-44ee-aec9-35cfb215026b req-c052c0cd-a1a2-47b7-939c-d30437ea3e01 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] No waiting events found dispatching network-vif-plugged-4dd5faac-d8ed-41ca-9160-c72beda8f636 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:18:32 user nova-compute[73091]: WARNING nova.compute.manager [req-5084fb58-cee7-44ee-aec9-35cfb215026b req-c052c0cd-a1a2-47b7-939c-d30437ea3e01 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Received unexpected event network-vif-plugged-4dd5faac-d8ed-41ca-9160-c72beda8f636 for instance with vm_state building and task_state spawning.
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-5084fb58-cee7-44ee-aec9-35cfb215026b req-c052c0cd-a1a2-47b7-939c-d30437ea3e01 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Received event network-vif-plugged-4dd5faac-d8ed-41ca-9160-c72beda8f636 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5084fb58-cee7-44ee-aec9-35cfb215026b req-c052c0cd-a1a2-47b7-939c-d30437ea3e01 service nova] Acquiring lock "9a2dd138-1c20-4114-afac-e272aba39537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5084fb58-cee7-44ee-aec9-35cfb215026b req-c052c0cd-a1a2-47b7-939c-d30437ea3e01 service nova] Lock "9a2dd138-1c20-4114-afac-e272aba39537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-5084fb58-cee7-44ee-aec9-35cfb215026b req-c052c0cd-a1a2-47b7-939c-d30437ea3e01 service nova] Lock "9a2dd138-1c20-4114-afac-e272aba39537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.manager [req-5084fb58-cee7-44ee-aec9-35cfb215026b req-c052c0cd-a1a2-47b7-939c-d30437ea3e01 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] No waiting events found dispatching network-vif-plugged-4dd5faac-d8ed-41ca-9160-c72beda8f636 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:18:32 user nova-compute[73091]: WARNING nova.compute.manager [req-5084fb58-cee7-44ee-aec9-35cfb215026b req-c052c0cd-a1a2-47b7-939c-d30437ea3e01 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Received unexpected event network-vif-plugged-4dd5faac-d8ed-41ca-9160-c72beda8f636 for instance with vm_state building and task_state spawning.
Aug 16 08:18:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.objects.instance [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lazy-loading 'numa_topology' on Instance uuid b989d006-e422-41eb-94f4-69667f2c26fe {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:18:32 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:18:32 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=6610MB free_disk=25.198013305664062GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.manager [None req-9db8d23b-f2ef-4a30-bfb4-e7cb0d1911a6 None None] [instance: 18850651-02ac-459a-838c-b3216bcbe131] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.446s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-9948723d-c445-454b-a8bb-5493f1cede0f tempest-TestShelveInstance-404090758 tempest-TestShelveInstance-404090758-project-member] Lock "b989d006-e422-41eb-94f4-69667f2c26fe" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.168s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance bd541280-cecf-4c1c-bd1f-f7edff830f1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4a6248b9-f577-4efd-baa2-eb5eb3e47495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance cc7973d9-c703-4345-bf58-ccbe80fd07ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance daf2b789-eba2-419b-99f6-be8f483151ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4f76c866-84a8-499c-a96c-21a2d65ca3d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 7aded393-c408-48d9-a30c-78b62ce0d09e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 935af9fd-600a-4c48-873b-b39126081748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 6a927702-8a5e-47d8-99de-b049f20b29a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance a79098c3-784e-4315-8fd0-0ff883d4f6e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4db26226-32ce-458d-ab6c-8019ae0032fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 99b8e77d-d296-4e72-b961-2f94c925f9ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 464df5c5-3bcd-4985-a609-fb49b5f1be12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4bfc7896-7001-48e3-a768-1030c3eb8485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 9a2dd138-1c20-4114-afac-e272aba39537 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:18:32 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173913.7260396, 9a2dd138-1c20-4114-afac-e272aba39537 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:18:33 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] VM Resumed (Lifecycle Event)
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:18:33 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Instance spawned successfully.
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:18:33 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173913.7277622, 9a2dd138-1c20-4114-afac-e272aba39537 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:18:33 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] VM Started (Lifecycle Event)
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:18:33 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:18:33 user nova-compute[73091]: INFO nova.compute.manager [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 16 08:18:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:18:33 user nova-compute[73091]: INFO nova.compute.manager [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Took 27.14 seconds to build instance.
Aug 16 08:18:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cf438717-ccdd-4da3-ba9b-275337734c44 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "9a2dd138-1c20-4114-afac-e272aba39537" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.236s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:34 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173899.6333785, 476de8ea-30dd-4b52-be37-f134e445757f => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:18:34 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] VM Stopped (Lifecycle Event)
Aug 16 08:18:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-1c60f53a-db0b-47fe-a781-0130b228039e None None] [instance: 476de8ea-30dd-4b52-be37-f134e445757f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:18:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BJqkVpWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:18:35 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:18:35 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:18:35 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab1ae02-cde8-48bb-a272-ef863b65101f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:18:35 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98106a1-e828-47f2-9cdf-011d2fabaa09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23] added
Aug 16 08:18:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9c1058-184a-411d-84cb-80369b65f0af]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b9682c-d806-450d-8207-1c85b20afd96]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BJqkVpWD {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BJqkVpWD" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ae9245-82eb-41ba-afca-788f7f2bc40f]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BJqkVpWD'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[313de326-8be0-47d3-94cf-4413e8a3d181]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[933ae901-03f3-4711-bd34-1674f6155bcb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:35 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:35 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:18:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:35 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:35 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:18:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1885d67c-7f7d-4a7f-a460-2c7ce3a8ec7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23, portal: 172.16.0.220,3260]
Aug 16 08:18:35 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23, portal: 172.16.0.220,3260] successful.
Aug 16 08:18:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2105d2e0-4dd9-44f0-a98e-d2fd8c99d49d]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68c5ef8-f180-4a0e-b996-ebe2e074e4ae]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:35 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:35 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:18:35 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 (non-flash)
Aug 16 08:18:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:35 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:35 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:18:35 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 (non-flash)
Aug 16 08:18:35 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[873a5b3f-ffff-46c7-a749-462cbc93e6c3]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:18:35 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BJqkVpWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:18:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:18:36 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23132306563383666', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:18:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132306563383666', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:18:36 user nova-compute[73091]: DEBUG nova.objects.instance [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lazy-loading 'flavor' on Instance uuid a79098c3-784e-4315-8fd0-0ff883d4f6e3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:18:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 08:18:36 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:18:36 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 08:18:36 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 16 08:18:36 user nova-compute[73091]:   <serial>0e2bdbe6-bb4f-45c6-aeb3-50258d884a23</serial>
Aug 16 08:18:36 user nova-compute[73091]: </disk>
Aug 16 08:18:36 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 08:18:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:18:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:18:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:18:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] No VIF found with MAC fa:16:3e:bb:cf:90, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:18:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-63033140-42e5-4275-9736-7cb62a5137f9 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.205s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:38 user nova-compute[73091]: INFO nova.compute.manager [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Detaching volume 0e2bdbe6-bb4f-45c6-aeb3-50258d884a23
Aug 16 08:18:38 user nova-compute[73091]: INFO nova.virt.block_device [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Attempting to driver detach volume 0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 from mountpoint /dev/vdc
Aug 16 08:18:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Attempting to detach device vdc from instance a79098c3-784e-4315-8fd0-0ff883d4f6e3 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:18:38 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:18:38 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 08:18:38 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 16 08:18:38 user nova-compute[73091]:   <serial>0e2bdbe6-bb4f-45c6-aeb3-50258d884a23</serial>
Aug 16 08:18:38 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 08:18:38 user nova-compute[73091]: </disk>
Aug 16 08:18:38 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:18:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Successfully detached device vdc from instance a79098c3-784e-4315-8fd0-0ff883d4f6e3 from the persistent domain config.
Aug 16 08:18:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a79098c3-784e-4315-8fd0-0ff883d4f6e3 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:18:38 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:18:38 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 08:18:38 user nova-compute[73091]:   <target dev="vdc" bus="virtio"/>
Aug 16 08:18:38 user nova-compute[73091]:   <serial>0e2bdbe6-bb4f-45c6-aeb3-50258d884a23</serial>
Aug 16 08:18:38 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 08:18:38 user nova-compute[73091]: </disk>
Aug 16 08:18:38 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Received event <DeviceRemovedEvent: 1692173918.818616, a79098c3-784e-4315-8fd0-0ff883d4f6e3 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a79098c3-784e-4315-8fd0-0ff883d4f6e3 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 08:18:38 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Successfully detached device vdc from instance a79098c3-784e-4315-8fd0-0ff883d4f6e3 from the live domain config.
Aug 16 08:18:38 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BJqkVpWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:18:38 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:18:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1143038-ad0d-46f5-a439-aaf57cfd3977]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b53ebd-3112-4830-9625-f0741ed17a47]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:38 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:38 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:18:38 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 (non-flash)
Aug 16 08:18:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:18:38 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:18:38 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:18:38 user nova-compute[73091]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 (non-flash)
Aug 16 08:18:38 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9017d1900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23'): ({'sde'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Removing single pathed devices sde {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bab1036-b1bb-4d6a-ad1f-92f0e27744d3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb8ba25-8373-472d-a9eb-73fe2e7eb441]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Flushing IO for device /dev/sde {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[3802d38d-f81f-4aad-be21-27eb6143b5e3]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:18:38 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[600d37cf-2455-4ac1-8e43-715b9bf2394f]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] SCSI volumes sde have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b9d32b-3059-4cd6-bd07-2430776d19c8]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa5cccc-670d-4cd1-a955-9a2cdf184bc7]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23, portal: 172.16.0.220,3260]
Aug 16 08:18:39 user nova-compute[73091]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23, portal: 172.16.0.220,3260] successful.
Aug 16 08:18:39 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2bdbe6-bb4f-45c6-aeb3-50258d884a23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d105f1f7-f704-4d3f-b35a-0980fc939d28]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] <== disconnect_volume: return (300ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "7aded393-c408-48d9-a30c-78b62ce0d09e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:39 user nova-compute[73091]: INFO nova.compute.manager [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Terminating instance
Aug 16 08:18:39 user nova-compute[73091]: DEBUG nova.compute.manager [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-17ba2705-c50e-4f54-b524-2375f4d473e8 req-96531f3d-2ddf-4507-b7cc-e3b8cfb462ab service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Received event network-vif-unplugged-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-17ba2705-c50e-4f54-b524-2375f4d473e8 req-96531f3d-2ddf-4507-b7cc-e3b8cfb462ab service nova] Acquiring lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-17ba2705-c50e-4f54-b524-2375f4d473e8 req-96531f3d-2ddf-4507-b7cc-e3b8cfb462ab service nova] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-17ba2705-c50e-4f54-b524-2375f4d473e8 req-96531f3d-2ddf-4507-b7cc-e3b8cfb462ab service nova] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-17ba2705-c50e-4f54-b524-2375f4d473e8 req-96531f3d-2ddf-4507-b7cc-e3b8cfb462ab service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] No waiting events found dispatching network-vif-unplugged-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG nova.compute.manager [req-17ba2705-c50e-4f54-b524-2375f4d473e8 req-96531f3d-2ddf-4507-b7cc-e3b8cfb462ab service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Received event network-vif-unplugged-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:39 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Instance destroyed successfully.
Aug 16 08:18:39 user nova-compute[73091]: DEBUG nova.objects.instance [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lazy-loading 'resources' on Instance uuid 7aded393-c408-48d9-a30c-78b62ce0d09e {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1631314331',display_name='tempest-AttachVolumeNegativeTest-server-1631314331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1631314331',id=15,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJT9tEJYWRukuLsIISH9So0PukNxFba+upzbML8U2xsuhxMyzDobw4gu4wcdKc5G/aCAscDHBXWEvSXFR6Ps3p4a3sohKsWzZ8/0Kvc/TR+Tly/3dR95fLMtwRNE0IAP4w==',key_name='tempest-keypair-2134618451',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:12:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8186c961465c48fc800e3b1ecd4ed077',ramdisk_id='',reservation_id='r-dtvoz8vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1216940805',owner_user_name='tempest-AttachVolumeNegativeTest-1216940805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='741b35d305b340bfb00ecffb56a143b8',uuid=7aded393-c408-48d9-a30c-78b62ce0d09e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "address": "fa:16:3e:87:20:9c", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfabf307b-a0", "ovs_interfaceid": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converting VIF {"id": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "address": "fa:16:3e:87:20:9c", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfabf307b-a0", "ovs_interfaceid": "fabf307b-a015-44fb-a0d5-f44e2d47b2f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:20:9c,bridge_name='br-int',has_traffic_filtering=True,id=fabf307b-a015-44fb-a0d5-f44e2d47b2f1,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfabf307b-a0') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG os_vif [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:20:9c,bridge_name='br-int',has_traffic_filtering=True,id=fabf307b-a015-44fb-a0d5-f44e2d47b2f1,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfabf307b-a0') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfabf307b-a0, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:40 user nova-compute[73091]: INFO os_vif [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:20:9c,bridge_name='br-int',has_traffic_filtering=True,id=fabf307b-a015-44fb-a0d5-f44e2d47b2f1,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfabf307b-a0')
Aug 16 08:18:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Deleting instance files /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e_del
Aug 16 08:18:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Deletion of /opt/stack/data/nova/instances/7aded393-c408-48d9-a30c-78b62ce0d09e_del complete
Aug 16 08:18:40 user nova-compute[73091]: INFO nova.compute.manager [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 08:18:40 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 08:18:40 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 08:18:40 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 08:18:41 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:18:41 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Took 1.02 seconds to deallocate network for instance.
Aug 16 08:18:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-e4584b50-c947-4fcf-938b-6d4fa68922f4 req-59eab6ee-e9a7-47cc-b878-e38e35a59b20 service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Received event network-vif-deleted-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:41 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:18:41 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:18:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-2277e2cf-7625-455d-8f38-e8121ffda823 req-229d03c5-9193-44e6-b994-537340fc5eca service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Received event network-vif-plugged-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2277e2cf-7625-455d-8f38-e8121ffda823 req-229d03c5-9193-44e6-b994-537340fc5eca service nova] Acquiring lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2277e2cf-7625-455d-8f38-e8121ffda823 req-229d03c5-9193-44e6-b994-537340fc5eca service nova] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2277e2cf-7625-455d-8f38-e8121ffda823 req-229d03c5-9193-44e6-b994-537340fc5eca service nova] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:41 user nova-compute[73091]: DEBUG nova.compute.manager [req-2277e2cf-7625-455d-8f38-e8121ffda823 req-229d03c5-9193-44e6-b994-537340fc5eca service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] No waiting events found dispatching network-vif-plugged-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:18:41 user nova-compute[73091]: WARNING nova.compute.manager [req-2277e2cf-7625-455d-8f38-e8121ffda823 req-229d03c5-9193-44e6-b994-537340fc5eca service nova] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Received unexpected event network-vif-plugged-fabf307b-a015-44fb-a0d5-f44e2d47b2f1 for instance with vm_state deleted and task_state None.
Aug 16 08:18:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:41 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Deleted allocations for instance 7aded393-c408-48d9-a30c-78b62ce0d09e
Aug 16 08:18:41 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-af531686-5eeb-4f81-9776-b6689ed4fe68 tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "7aded393-c408-48d9-a30c-78b62ce0d09e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.581s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "4db26226-32ce-458d-ab6c-8019ae0032fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "4db26226-32ce-458d-ab6c-8019ae0032fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:42 user nova-compute[73091]: INFO nova.compute.manager [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Terminating instance
Aug 16 08:18:42 user nova-compute[73091]: DEBUG nova.compute.manager [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lazy-loading 'flavor' on Instance uuid a79098c3-784e-4315-8fd0-0ff883d4f6e3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-770d9f86-50e3-46cb-87c4-61ebc875e21e tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.999s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Instance destroyed successfully.
Aug 16 08:18:42 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lazy-loading 'resources' on Instance uuid 4db26226-32ce-458d-ab6c-8019ae0032fd {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1286495614',display_name='tempest-VolumesAdminNegativeTest-server-1286495614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1286495614',id=21,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:16:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84db3210bb264fa8a51ff058417879cf',ramdisk_id='',reservation_id='r-em00dvim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-285658015',owner_user_name='tempest-VolumesAdminNegativeTest-285658015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:16:45Z,user_data=None,user_id='193403aa9c4549cd936453ab6ef9c1d1',uuid=4db26226-32ce-458d-ab6c-8019ae0032fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "address": "fa:16:3e:e1:a8:25", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d90ba09-5f", "ovs_interfaceid": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Converting VIF {"id": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "address": "fa:16:3e:e1:a8:25", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d90ba09-5f", "ovs_interfaceid": "4d90ba09-5f00-4d5b-aa2b-4c175593a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a8:25,bridge_name='br-int',has_traffic_filtering=True,id=4d90ba09-5f00-4d5b-aa2b-4c175593a04f,network=Network(323e7b6f-721c-4ee0-aa42-fea90e1b7e97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d90ba09-5f') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG os_vif [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a8:25,bridge_name='br-int',has_traffic_filtering=True,id=4d90ba09-5f00-4d5b-aa2b-4c175593a04f,network=Network(323e7b6f-721c-4ee0-aa42-fea90e1b7e97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d90ba09-5f') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d90ba09-5f, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:18:42 user nova-compute[73091]: INFO os_vif [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a8:25,bridge_name='br-int',has_traffic_filtering=True,id=4d90ba09-5f00-4d5b-aa2b-4c175593a04f,network=Network(323e7b6f-721c-4ee0-aa42-fea90e1b7e97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d90ba09-5f')
Aug 16 08:18:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Deleting instance files /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd_del
Aug 16 08:18:42 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Deletion of /opt/stack/data/nova/instances/4db26226-32ce-458d-ab6c-8019ae0032fd_del complete
Aug 16 08:18:42 user nova-compute[73091]: INFO nova.compute.manager [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 16 08:18:42 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 08:18:42 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173908.3071463, b989d006-e422-41eb-94f4-69667f2c26fe => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:18:43 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] VM Stopped (Lifecycle Event)
Aug 16 08:18:43 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a02208dc-b9c5-4341-b8ac-e15b77a84602 None None] [instance: b989d006-e422-41eb-94f4-69667f2c26fe] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:18:43 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Took 0.46 seconds to deallocate network for instance.
Aug 16 08:18:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-0a567b40-0842-4ae4-a176-b2d61f34c0fe req-205ee91e-20a1-45fe-9a6a-26751dd65d2a service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Received event network-vif-deleted-4d90ba09-5f00-4d5b-aa2b-4c175593a04f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:43 user nova-compute[73091]: INFO nova.compute.manager [req-0a567b40-0842-4ae4-a176-b2d61f34c0fe req-205ee91e-20a1-45fe-9a6a-26751dd65d2a service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Neutron deleted interface 4d90ba09-5f00-4d5b-aa2b-4c175593a04f; detaching it from the instance and deleting it from the info cache
Aug 16 08:18:43 user nova-compute[73091]: DEBUG nova.network.neutron [req-0a567b40-0842-4ae4-a176-b2d61f34c0fe req-205ee91e-20a1-45fe-9a6a-26751dd65d2a service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-0a567b40-0842-4ae4-a176-b2d61f34c0fe req-205ee91e-20a1-45fe-9a6a-26751dd65d2a service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Detach interface failed, port_id=4d90ba09-5f00-4d5b-aa2b-4c175593a04f, reason: Instance 4db26226-32ce-458d-ab6c-8019ae0032fd could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-04feaeea-2242-4eb1-a1d5-970632e0bb45 req-d47073d4-7e5f-4829-8939-92f865a371ca service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Received event network-vif-unplugged-4d90ba09-5f00-4d5b-aa2b-4c175593a04f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04feaeea-2242-4eb1-a1d5-970632e0bb45 req-d47073d4-7e5f-4829-8939-92f865a371ca service nova] Acquiring lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04feaeea-2242-4eb1-a1d5-970632e0bb45 req-d47073d4-7e5f-4829-8939-92f865a371ca service nova] Lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04feaeea-2242-4eb1-a1d5-970632e0bb45 req-d47073d4-7e5f-4829-8939-92f865a371ca service nova] Lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-04feaeea-2242-4eb1-a1d5-970632e0bb45 req-d47073d4-7e5f-4829-8939-92f865a371ca service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] No waiting events found dispatching network-vif-unplugged-4d90ba09-5f00-4d5b-aa2b-4c175593a04f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:18:43 user nova-compute[73091]: WARNING nova.compute.manager [req-04feaeea-2242-4eb1-a1d5-970632e0bb45 req-d47073d4-7e5f-4829-8939-92f865a371ca service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Received unexpected event network-vif-unplugged-4d90ba09-5f00-4d5b-aa2b-4c175593a04f for instance with vm_state deleted and task_state None.
Aug 16 08:18:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-04feaeea-2242-4eb1-a1d5-970632e0bb45 req-d47073d4-7e5f-4829-8939-92f865a371ca service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Received event network-vif-plugged-4d90ba09-5f00-4d5b-aa2b-4c175593a04f {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04feaeea-2242-4eb1-a1d5-970632e0bb45 req-d47073d4-7e5f-4829-8939-92f865a371ca service nova] Acquiring lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04feaeea-2242-4eb1-a1d5-970632e0bb45 req-d47073d4-7e5f-4829-8939-92f865a371ca service nova] Lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-04feaeea-2242-4eb1-a1d5-970632e0bb45 req-d47073d4-7e5f-4829-8939-92f865a371ca service nova] Lock "4db26226-32ce-458d-ab6c-8019ae0032fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG nova.compute.manager [req-04feaeea-2242-4eb1-a1d5-970632e0bb45 req-d47073d4-7e5f-4829-8939-92f865a371ca service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] No waiting events found dispatching network-vif-plugged-4d90ba09-5f00-4d5b-aa2b-4c175593a04f {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:18:43 user nova-compute[73091]: WARNING nova.compute.manager [req-04feaeea-2242-4eb1-a1d5-970632e0bb45 req-d47073d4-7e5f-4829-8939-92f865a371ca service nova] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Received unexpected event network-vif-plugged-4d90ba09-5f00-4d5b-aa2b-4c175593a04f for instance with vm_state deleted and task_state None.
Aug 16 08:18:43 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:18:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:43 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Deleted allocations for instance 4db26226-32ce-458d-ab6c-8019ae0032fd
Aug 16 08:18:43 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cd0883e9-7f0f-469e-9b47-388b58f9a7c9 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "4db26226-32ce-458d-ab6c-8019ae0032fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.727s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-762b322e-29f1-40b6-b052-23bce25c6094 req-575d0140-59f8-4b13-9b4f-cfaf6427bb32 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Received event network-changed-d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG nova.compute.manager [req-762b322e-29f1-40b6-b052-23bce25c6094 req-575d0140-59f8-4b13-9b4f-cfaf6427bb32 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Refreshing instance network info cache due to event network-changed-d5c717e4-8e0e-452f-9103-67e9410273e2. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-762b322e-29f1-40b6-b052-23bce25c6094 req-575d0140-59f8-4b13-9b4f-cfaf6427bb32 service nova] Acquiring lock "refresh_cache-99b8e77d-d296-4e72-b961-2f94c925f9ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-762b322e-29f1-40b6-b052-23bce25c6094 req-575d0140-59f8-4b13-9b4f-cfaf6427bb32 service nova] Acquired lock "refresh_cache-99b8e77d-d296-4e72-b961-2f94c925f9ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-762b322e-29f1-40b6-b052-23bce25c6094 req-575d0140-59f8-4b13-9b4f-cfaf6427bb32 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Refreshing network info cache for port d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "99b8e77d-d296-4e72-b961-2f94c925f9ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'flavor' on Instance uuid 99b8e77d-d296-4e72-b961-2f94c925f9ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "99b8e77d-d296-4e72-b961-2f94c925f9ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:18:54 user nova-compute[73091]: INFO nova.compute.manager [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Attaching volume af77b663-c459-4119-a4c2-fa4822759d05 to /dev/vdb
Aug 16 08:18:54 user nova-compute[73091]: DEBUG os_brick.utils [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[565410a9-2f5e-4144-9559-71f2176abe22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7840de-aad6-4f12-8fac-58ab6fc1b4bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9242ff53-641b-47b3-96ac-0ec2918d10b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a921723-c6f3-4b50-b2ba-c868033e9cce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:18:54 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f499afbc-c577-4b1c-a6d8-520a5756701e]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG os_brick.utils [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Updating existing volume attachment record: fefa593f-3556-443a-92eb-7cee0d37902d {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-762b322e-29f1-40b6-b052-23bce25c6094 req-575d0140-59f8-4b13-9b4f-cfaf6427bb32 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Updated VIF entry in instance network info cache for port d5c717e4-8e0e-452f-9103-67e9410273e2. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG nova.network.neutron [req-762b322e-29f1-40b6-b052-23bce25c6094 req-575d0140-59f8-4b13-9b4f-cfaf6427bb32 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Updating instance_info_cache with network_info: [{"id": "d5c717e4-8e0e-452f-9103-67e9410273e2", "address": "fa:16:3e:fd:bc:4b", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c717e4-8e", "ovs_interfaceid": "d5c717e4-8e0e-452f-9103-67e9410273e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-762b322e-29f1-40b6-b052-23bce25c6094 req-575d0140-59f8-4b13-9b4f-cfaf6427bb32 service nova] Releasing lock "refresh_cache-99b8e77d-d296-4e72-b961-2f94c925f9ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:18:54 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173919.9688587, 7aded393-c408-48d9-a30c-78b62ce0d09e => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:18:54 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] VM Stopped (Lifecycle Event)
Aug 16 08:18:54 user nova-compute[73091]: DEBUG nova.compute.manager [None req-72fa978c-296a-4cb8-834d-26a5a16ac98e None None] [instance: 7aded393-c408-48d9-a30c-78b62ce0d09e] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:18:57 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173922.801929, 4db26226-32ce-458d-ab6c-8019ae0032fd => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:18:57 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] VM Stopped (Lifecycle Event)
Aug 16 08:18:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-60b0cd58-cfe8-4cdb-b3ed-a77dd6432365 None None] [instance: 4db26226-32ce-458d-ab6c-8019ae0032fd] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:18:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:18:58 user nova-compute[73091]: DEBUG nova.compute.manager [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:18:58 user nova-compute[73091]: INFO nova.compute.manager [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] instance snapshotting
Aug 16 08:18:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Beginning live snapshot process
Aug 16 08:18:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json -f qcow2 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpto3dybg5/108915d75a254697a8fd0c84622d2aaa.delta 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:18:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpto3dybg5/108915d75a254697a8fd0c84622d2aaa.delta 1073741824" returned: 0 in 0.046s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:18:59 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 08:18:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:19:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73091) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 08:19:00 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 08:19:00 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 08:19:00 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpto3dybg5/108915d75a254697a8fd0c84622d2aaa.delta /opt/stack/data/nova/instances/snapshots/tmpto3dybg5/108915d75a254697a8fd0c84622d2aaa {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:01 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpto3dybg5/108915d75a254697a8fd0c84622d2aaa.delta /opt/stack/data/nova/instances/snapshots/tmpto3dybg5/108915d75a254697a8fd0c84622d2aaa" returned: 0 in 0.411s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Snapshot extracted, beginning image upload
Aug 16 08:19:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:03 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Snapshot image upload complete
Aug 16 08:19:03 user nova-compute[73091]: INFO nova.compute.manager [None req-bea93d97-1312-414a-8649-3010334bc0b6 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 464df5c5-3bcd-4985-a609-fb49b5f1be12] Took 5.00 seconds to snapshot the instance on the hypervisor.
Aug 16 08:19:03 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvzCXYrw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:19:03 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:19:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:19:03 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:19:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:19:03 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:19:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da15d53-2ac2-4611-b551-9d5e4af23fe4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:19:03 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd223b0-7ce1-423b-87af-8924a3467359]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05] added
Aug 16 08:19:03 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c729e38f-0cd4-4ca7-8395-1f02bf077968]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:03 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa0d906-45f0-4ae0-aad2-dfc1e1613256]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvzCXYrw {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvzCXYrw" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9673dc09-7376-4ed4-a9da-212e189ee662]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HvzCXYrw'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8383258f-8c76-48c5-b943-483705e31661]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afa9602-6662-4388-a40d-2bea924ee54f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:04 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:19:04 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:04 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:19:04 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18526f9-0ab3-4bb4-a38a-cd1385178f9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05, portal: 172.16.0.220,3260]
Aug 16 08:19:04 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05, portal: 172.16.0.220,3260] successful.
Aug 16 08:19:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6c98cf-ebb9-496e-81fe-a93be662f4da]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57a2e07-6b38-4349-aec0-9dc1c1705eb0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:04 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:19:04 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:04 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:04 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:19:04 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:04 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:04 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[220c49de-bbab-44e8-9695-a84f5ef80f58]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvzCXYrw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:19:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:19:05 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23763666534366239', 'path': '/dev/sde'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:19:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763666534366239', 'path': '/dev/sde'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:19:05 user nova-compute[73091]: DEBUG nova.objects.instance [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'flavor' on Instance uuid 99b8e77d-d296-4e72-b961-2f94c925f9ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 08:19:05 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:19:05 user nova-compute[73091]:   <source dev="/dev/sde"/>
Aug 16 08:19:05 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:19:05 user nova-compute[73091]:   <serial>af77b663-c459-4119-a4c2-fa4822759d05</serial>
Aug 16 08:19:05 user nova-compute[73091]: </disk>
Aug 16 08:19:05 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 08:19:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:19:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:19:05 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No VIF found with MAC fa:16:3e:fd:bc:4b, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:19:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-cbdd61ff-73de-4506-b1f0-2c38bc87c0ea tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.415s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:06 user nova-compute[73091]: INFO nova.compute.manager [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Rescuing
Aug 16 08:19:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "refresh_cache-99b8e77d-d296-4e72-b961-2f94c925f9ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:19:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquired lock "refresh_cache-99b8e77d-d296-4e72-b961-2f94c925f9ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:19:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:19:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Updating instance_info_cache with network_info: [{"id": "d5c717e4-8e0e-452f-9103-67e9410273e2", "address": "fa:16:3e:fd:bc:4b", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c717e4-8e", "ovs_interfaceid": "d5c717e4-8e0e-452f-9103-67e9410273e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:19:07 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Releasing lock "refresh_cache-99b8e77d-d296-4e72-b961-2f94c925f9ba" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:19:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:07 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-6462fd7b-d2c0-4754-9cdc-653ceff4d4f2 req-40206a52-2e0f-40c5-9adc-445f0beaa627 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Received event network-vif-unplugged-d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6462fd7b-d2c0-4754-9cdc-653ceff4d4f2 req-40206a52-2e0f-40c5-9adc-445f0beaa627 service nova] Acquiring lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6462fd7b-d2c0-4754-9cdc-653ceff4d4f2 req-40206a52-2e0f-40c5-9adc-445f0beaa627 service nova] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6462fd7b-d2c0-4754-9cdc-653ceff4d4f2 req-40206a52-2e0f-40c5-9adc-445f0beaa627 service nova] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-6462fd7b-d2c0-4754-9cdc-653ceff4d4f2 req-40206a52-2e0f-40c5-9adc-445f0beaa627 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] No waiting events found dispatching network-vif-unplugged-d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:19:08 user nova-compute[73091]: WARNING nova.compute.manager [req-6462fd7b-d2c0-4754-9cdc-653ceff4d4f2 req-40206a52-2e0f-40c5-9adc-445f0beaa627 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Received unexpected event network-vif-unplugged-d5c717e4-8e0e-452f-9103-67e9410273e2 for instance with vm_state active and task_state rescuing.
Aug 16 08:19:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Instance destroyed successfully.
Aug 16 08:19:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Attempting rescue
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 08:19:08 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Creating image(s)
Aug 16 08:19:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "/opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "/opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "/opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'trusted_certs' on Instance uuid 99b8e77d-d296-4e72-b961-2f94c925f9ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.169s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk.rescue {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk.rescue" returned: 0 in 0.048s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'migration_context' on Instance uuid 99b8e77d-d296-4e72-b961-2f94c925f9ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Start _get_guest_xml network_info=[{"id": "d5c717e4-8e0e-452f-9103-67e9410273e2", "address": "fa:16:3e:fd:bc:4b", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "vif_mac": "fa:16:3e:fd:bc:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c717e4-8e", "ovs_interfaceid": "d5c717e4-8e0e-452f-9103-67e9410273e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'resources' on Instance uuid 99b8e77d-d296-4e72-b961-2f94c925f9ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'numa_topology' on Instance uuid 99b8e77d-d296-4e72-b961-2f94c925f9ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:08 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:19:08 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:19:08 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'vcpu_model' on Instance uuid 99b8e77d-d296-4e72-b961-2f94c925f9ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1784357027',display_name='tempest-ServerRescueNegativeTestJSON-server-1784357027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1784357027',id=22,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcFLI3gIWyr2cc1kh2NjNyq3UfhIFXh3ffM5z66gNF8e9ytXcsANspmvOtri0iX1W/fC4OttZE+yE2MEuZBrGswiMg6mpXyDN9lDOFTtHLPxVGwS02dfGNfPyKXa4FcoA==',key_name='tempest-keypair-1615619142',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:17:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='417ed7a5d52f4f7eaa4b6328864808ea',ramdisk_id='',reservation_id='r-7aow83dj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1374385894',owner_user_name='tempest-ServerRescueNegativeTestJSON-1374385894-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a24330919014a2985e7926747cbbcdc',uuid=99b8e77d-d296-4e72-b961-2f94c925f9ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5c717e4-8e0e-452f-9103-67e9410273e2", "address": "fa:16:3e:fd:bc:4b", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "vif_mac": "fa:16:3e:fd:bc:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c717e4-8e", "ovs_interfaceid": "d5c717e4-8e0e-452f-9103-67e9410273e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:19:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converting VIF {"id": "d5c717e4-8e0e-452f-9103-67e9410273e2", "address": "fa:16:3e:fd:bc:4b", "network": {"id": "97aabc7b-cb66-4b3a-92b5-dc77bd1fabed", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1466628679-network", "vif_mac": "fa:16:3e:fd:bc:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "417ed7a5d52f4f7eaa4b6328864808ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5c717e4-8e", "ovs_interfaceid": "d5c717e4-8e0e-452f-9103-67e9410273e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:19:09 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:bc:4b,bridge_name='br-int',has_traffic_filtering=True,id=d5c717e4-8e0e-452f-9103-67e9410273e2,network=Network(97aabc7b-cb66-4b3a-92b5-dc77bd1fabed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5c717e4-8e') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:19:09 user nova-compute[73091]: DEBUG nova.objects.instance [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] Lazy-loading 'pci_devices' on Instance uuid 99b8e77d-d296-4e72-b961-2f94c925f9ba {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:19:09 user nova-compute[73091]:   <uuid>99b8e77d-d296-4e72-b961-2f94c925f9ba</uuid>
Aug 16 08:19:09 user nova-compute[73091]:   <name>instance-00000016</name>
Aug 16 08:19:09 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:19:09 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:19:09 user nova-compute[73091]:   <metadata>
Aug 16 08:19:09 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:19:09 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:19:09 user nova-compute[73091]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1784357027</nova:name>
Aug 16 08:19:09 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:19:08</nova:creationTime>
Aug 16 08:19:09 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:19:09 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:19:09 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:19:09 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:19:09 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:19:09 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:19:09 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:19:09 user nova-compute[73091]:       <nova:owner>
Aug 16 08:19:09 user nova-compute[73091]:         <nova:user uuid="7a24330919014a2985e7926747cbbcdc">tempest-ServerRescueNegativeTestJSON-1374385894-project-member</nova:user>
Aug 16 08:19:09 user nova-compute[73091]:         <nova:project uuid="417ed7a5d52f4f7eaa4b6328864808ea">tempest-ServerRescueNegativeTestJSON-1374385894</nova:project>
Aug 16 08:19:09 user nova-compute[73091]:       </nova:owner>
Aug 16 08:19:09 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:19:09 user nova-compute[73091]:       <nova:ports>
Aug 16 08:19:09 user nova-compute[73091]:         <nova:port uuid="d5c717e4-8e0e-452f-9103-67e9410273e2">
Aug 16 08:19:09 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 08:19:09 user nova-compute[73091]:         </nova:port>
Aug 16 08:19:09 user nova-compute[73091]:       </nova:ports>
Aug 16 08:19:09 user nova-compute[73091]:     </nova:instance>
Aug 16 08:19:09 user nova-compute[73091]:   </metadata>
Aug 16 08:19:09 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:19:09 user nova-compute[73091]:     <system>
Aug 16 08:19:09 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:19:09 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:19:09 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:19:09 user nova-compute[73091]:       <entry name="serial">99b8e77d-d296-4e72-b961-2f94c925f9ba</entry>
Aug 16 08:19:09 user nova-compute[73091]:       <entry name="uuid">99b8e77d-d296-4e72-b961-2f94c925f9ba</entry>
Aug 16 08:19:09 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:19:09 user nova-compute[73091]:     </system>
Aug 16 08:19:09 user nova-compute[73091]:   </sysinfo>
Aug 16 08:19:09 user nova-compute[73091]:   <os>
Aug 16 08:19:09 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:19:09 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:19:09 user nova-compute[73091]:   </os>
Aug 16 08:19:09 user nova-compute[73091]:   <features>
Aug 16 08:19:09 user nova-compute[73091]:     <acpi/>
Aug 16 08:19:09 user nova-compute[73091]:     <apic/>
Aug 16 08:19:09 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:19:09 user nova-compute[73091]:   </features>
Aug 16 08:19:09 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:19:09 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:19:09 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:19:09 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:19:09 user nova-compute[73091]:   </clock>
Aug 16 08:19:09 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:19:09 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:19:09 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:19:09 user nova-compute[73091]:   </cpu>
Aug 16 08:19:09 user nova-compute[73091]:   <devices>
Aug 16 08:19:09 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:19:09 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:19:09 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk.rescue"/>
Aug 16 08:19:09 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:19:09 user nova-compute[73091]:     </disk>
Aug 16 08:19:09 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:19:09 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:19:09 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk"/>
Aug 16 08:19:09 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 08:19:09 user nova-compute[73091]:     </disk>
Aug 16 08:19:09 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:19:09 user nova-compute[73091]:       <mac address="fa:16:3e:fd:bc:4b"/>
Aug 16 08:19:09 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:19:09 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:19:09 user nova-compute[73091]:       <target dev="tapd5c717e4-8e"/>
Aug 16 08:19:09 user nova-compute[73091]:     </interface>
Aug 16 08:19:09 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:19:09 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/console.log" append="off"/>
Aug 16 08:19:09 user nova-compute[73091]:     </serial>
Aug 16 08:19:09 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:19:09 user nova-compute[73091]:     <video>
Aug 16 08:19:09 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:19:09 user nova-compute[73091]:     </video>
Aug 16 08:19:09 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:19:09 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:19:09 user nova-compute[73091]:     </rng>
Aug 16 08:19:09 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:19:09 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:19:09 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:19:09 user nova-compute[73091]:     </memballoon>
Aug 16 08:19:09 user nova-compute[73091]:   </devices>
Aug 16 08:19:09 user nova-compute[73091]: </domain>
Aug 16 08:19:09 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:19:09 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Instance destroyed successfully.
Aug 16 08:19:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:19:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:19:09 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] No VIF found with MAC fa:16:3e:fd:bc:4b, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:19:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-6ea64144-510f-4fb6-91e5-c716224b8fe0 req-639f53a5-ea79-4686-89b1-3db931cb418d service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Received event network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:19:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ea64144-510f-4fb6-91e5-c716224b8fe0 req-639f53a5-ea79-4686-89b1-3db931cb418d service nova] Acquiring lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ea64144-510f-4fb6-91e5-c716224b8fe0 req-639f53a5-ea79-4686-89b1-3db931cb418d service nova] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:10 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6ea64144-510f-4fb6-91e5-c716224b8fe0 req-639f53a5-ea79-4686-89b1-3db931cb418d service nova] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:10 user nova-compute[73091]: DEBUG nova.compute.manager [req-6ea64144-510f-4fb6-91e5-c716224b8fe0 req-639f53a5-ea79-4686-89b1-3db931cb418d service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] No waiting events found dispatching network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:19:10 user nova-compute[73091]: WARNING nova.compute.manager [req-6ea64144-510f-4fb6-91e5-c716224b8fe0 req-639f53a5-ea79-4686-89b1-3db931cb418d service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Received unexpected event network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 for instance with vm_state active and task_state rescuing.
Aug 16 08:19:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:10 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-6da349a5-3897-4141-8fa6-a8d52a7f9e92 req-f843ecda-96af-4a8a-b5a0-fb5f9682af24 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Received event network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:19:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6da349a5-3897-4141-8fa6-a8d52a7f9e92 req-f843ecda-96af-4a8a-b5a0-fb5f9682af24 service nova] Acquiring lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6da349a5-3897-4141-8fa6-a8d52a7f9e92 req-f843ecda-96af-4a8a-b5a0-fb5f9682af24 service nova] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6da349a5-3897-4141-8fa6-a8d52a7f9e92 req-f843ecda-96af-4a8a-b5a0-fb5f9682af24 service nova] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-6da349a5-3897-4141-8fa6-a8d52a7f9e92 req-f843ecda-96af-4a8a-b5a0-fb5f9682af24 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] No waiting events found dispatching network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:19:12 user nova-compute[73091]: WARNING nova.compute.manager [req-6da349a5-3897-4141-8fa6-a8d52a7f9e92 req-f843ecda-96af-4a8a-b5a0-fb5f9682af24 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Received unexpected event network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 for instance with vm_state active and task_state rescuing.
Aug 16 08:19:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-6da349a5-3897-4141-8fa6-a8d52a7f9e92 req-f843ecda-96af-4a8a-b5a0-fb5f9682af24 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Received event network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:19:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6da349a5-3897-4141-8fa6-a8d52a7f9e92 req-f843ecda-96af-4a8a-b5a0-fb5f9682af24 service nova] Acquiring lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6da349a5-3897-4141-8fa6-a8d52a7f9e92 req-f843ecda-96af-4a8a-b5a0-fb5f9682af24 service nova] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:12 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6da349a5-3897-4141-8fa6-a8d52a7f9e92 req-f843ecda-96af-4a8a-b5a0-fb5f9682af24 service nova] Lock "99b8e77d-d296-4e72-b961-2f94c925f9ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:12 user nova-compute[73091]: DEBUG nova.compute.manager [req-6da349a5-3897-4141-8fa6-a8d52a7f9e92 req-f843ecda-96af-4a8a-b5a0-fb5f9682af24 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] No waiting events found dispatching network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:19:12 user nova-compute[73091]: WARNING nova.compute.manager [req-6da349a5-3897-4141-8fa6-a8d52a7f9e92 req-f843ecda-96af-4a8a-b5a0-fb5f9682af24 service nova] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Received unexpected event network-vif-plugged-d5c717e4-8e0e-452f-9103-67e9410273e2 for instance with vm_state active and task_state rescuing.
Aug 16 08:19:12 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Removed pending event for 99b8e77d-d296-4e72-b961-2f94c925f9ba due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 08:19:12 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173952.7066228, 99b8e77d-d296-4e72-b961-2f94c925f9ba => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:19:12 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] VM Resumed (Lifecycle Event)
Aug 16 08:19:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-4d5e2910-ff02-49fe-b8d8-da3fdd8e5d56 tempest-ServerRescueNegativeTestJSON-1374385894 tempest-ServerRescueNegativeTestJSON-1374385894-project-member] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:19:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:19:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:19:12 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 08:19:12 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173952.7087667, 99b8e77d-d296-4e72-b961-2f94c925f9ba => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:19:12 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] VM Started (Lifecycle Event)
Aug 16 08:19:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:19:12 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 99b8e77d-d296-4e72-b961-2f94c925f9ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:19:12 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:14 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:16 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:17 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:20 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:22 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:24 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Starting heal instance info cache {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquired lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Forcefully refreshing network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG nova.network.neutron [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Updating instance_info_cache with network_info: [{"id": "df5af82e-6121-4551-aea4-adf6897bc4e1", "address": "fa:16:3e:49:79:1a", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5af82e-61", "ovs_interfaceid": "df5af82e-6121-4551-aea4-adf6897bc4e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Releasing lock "refresh_cache-4f76c866-84a8-499c-a96c-21a2d65ca3d4" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] [instance: 4f76c866-84a8-499c-a96c-21a2d65ca3d4] Updated the network info_cache for instance {{(pid=73091) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:27 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Auditing locally available compute resources for user (node: user) {{(pid=73091) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 08:19:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/464df5c5-3bcd-4985-a609-fb49b5f1be12/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:28 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:28 user nova-compute[73091]: INFO nova.compute.manager [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Detaching volume 787d3896-6e15-46ae-aa57-c119387ce0de
Aug 16 08:19:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bfc7896-7001-48e3-a768-1030c3eb8485/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:19:28 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:28 user nova-compute[73091]: INFO nova.virt.block_device [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Attempting to driver detach volume 787d3896-6e15-46ae-aa57-c119387ce0de from mountpoint /dev/vdb
Aug 16 08:19:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Attempting to detach device vdb from instance a79098c3-784e-4315-8fd0-0ff883d4f6e3 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 08:19:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:19:28 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:19:28 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 08:19:28 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:19:28 user nova-compute[73091]:   <serial>787d3896-6e15-46ae-aa57-c119387ce0de</serial>
Aug 16 08:19:28 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 08:19:28 user nova-compute[73091]: </disk>
Aug 16 08:19:28 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:19:28 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Successfully detached device vdb from instance a79098c3-784e-4315-8fd0-0ff883d4f6e3 from the persistent domain config.
Aug 16 08:19:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a79098c3-784e-4315-8fd0-0ff883d4f6e3 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 08:19:28 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:19:28 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:19:28 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 08:19:28 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:19:28 user nova-compute[73091]:   <serial>787d3896-6e15-46ae-aa57-c119387ce0de</serial>
Aug 16 08:19:28 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 08:19:28 user nova-compute[73091]: </disk>
Aug 16 08:19:28 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /opt/stack/data/nova/instances/99b8e77d-d296-4e72-b961-2f94c925f9ba/disk (vdb) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Received event <DeviceRemovedEvent: 1692173969.4380195, a79098c3-784e-4315-8fd0-0ff883d4f6e3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a79098c3-784e-4315-8fd0-0ff883d4f6e3 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 08:19:29 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Successfully detached device vdb from instance a79098c3-784e-4315-8fd0-0ff883d4f6e3 from the live domain config.
Aug 16 08:19:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nhiZIezq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:19:29 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e258499-381a-43e7-b881-89b6283cc8f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a73024e-e35f-419a-8ec9-e24dbca24c7a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:29 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:19:29 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:29 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:29 user nova-compute[73091]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de (non-flash)
Aug 16 08:19:29 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:29 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8f04e5b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de'): ({'sdc'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Removing single pathed devices sdc {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fdb63d-d236-4fea-a17b-4f2a13af3f78]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c757bfe1-d4f8-4eab-ace8-b869b70f6e4e]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Flushing IO for device /dev/sdc {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83f3f6c-cfc8-4cbe-a8b5-914dea30952c]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc7973d9-c703-4345-bf58-ccbe80fd07ac/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eff6c69-9721-4666-bab9-047a9adea67f]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] SCSI volumes sdc have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d08aa81-96ee-4ecd-8ecc-3906b4cb94ac]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6546549-ed71-4fbf-84c7-dfd45b7b6283]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de, portal: 172.16.0.220,3260]
Aug 16 08:19:29 user nova-compute[73091]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de, portal: 172.16.0.220,3260] successful.
Aug 16 08:19:29 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787d3896-6e15-46ae-aa57-c119387ce0de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d567d636-e08a-4d46-a2cc-782298f1698e]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] <== disconnect_volume: return (359ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:29 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a79098c3-784e-4315-8fd0-0ff883d4f6e3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a6248b9-f577-4efd-baa2-eb5eb3e47495/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:30 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73091) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 08:19:30 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd541280-cecf-4c1c-bd1f-f7edff830f1e/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:31 user nova-compute[73091]: DEBUG nova.objects.instance [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lazy-loading 'flavor' on Instance uuid a79098c3-784e-4315-8fd0-0ff883d4f6e3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-f3653905-ba53-4ac4-b048-6cbcc01554b6 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.997s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daf2b789-eba2-419b-99f6-be8f483151ba/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:31 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:32 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "452c1892-7356-487e-94e5-aaad1dbfb03f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "452c1892-7356-487e-94e5-aaad1dbfb03f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:33 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:19:33 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Hypervisor/Node resource view: name=user free_ram=7096MB free_disk=25.192142486572266GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=73091) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance bd541280-cecf-4c1c-bd1f-f7edff830f1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4a6248b9-f577-4efd-baa2-eb5eb3e47495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance cc7973d9-c703-4345-bf58-ccbe80fd07ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance daf2b789-eba2-419b-99f6-be8f483151ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4f76c866-84a8-499c-a96c-21a2d65ca3d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 935af9fd-600a-4c48-873b-b39126081748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 6a927702-8a5e-47d8-99de-b049f20b29a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance a79098c3-784e-4315-8fd0-0ff883d4f6e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 99b8e77d-d296-4e72-b961-2f94c925f9ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 464df5c5-3bcd-4985-a609-fb49b5f1be12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 4bfc7896-7001-48e3-a768-1030c3eb8485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 9a2dd138-1c20-4114-afac-e272aba39537 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Instance 452c1892-7356-487e-94e5-aaad1dbfb03f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73091) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73091) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.resource_tracker [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Compute_service record updated for user:user {{(pid=73091) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.441s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Cleaning up deleted instances {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:19:33 user nova-compute[73091]: INFO nova.compute.claims [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Claim successful on node user
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] There are 0 instances to clean {{(pid=73091) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:19:33 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73091) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73091) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG nova.network.neutron [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:19:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG nova.policy [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '741b35d305b340bfb00ecffb56a143b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8186c961465c48fc800e3b1ecd4ed077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG nova.compute.manager [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Start spawning the instance on the hypervisor. {{(pid=73091) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Creating instance directory {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 08:19:34 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Creating image(s)
Aug 16 08:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "/opt/stack/data/nova/instances/452c1892-7356-487e-94e5-aaad1dbfb03f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "/opt/stack/data/nova/instances/452c1892-7356-487e-94e5-aaad1dbfb03f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "/opt/stack/data/nova/instances/452c1892-7356-487e-94e5-aaad1dbfb03f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:34 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.198s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/452c1892-7356-487e-94e5-aaad1dbfb03f/disk 1073741824 {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa,backing_fmt=raw /opt/stack/data/nova/instances/452c1892-7356-487e-94e5-aaad1dbfb03f/disk 1073741824" returned: 0 in 0.058s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "4ad91fd7f5cc1924989e50a8ce778fe201a911fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG oslo_service.periodic_task [None req-06efe565-e9dc-4842-91cd-fcdf26d99d27 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73091) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ad91fd7f5cc1924989e50a8ce778fe201a911fa --force-share --output=json" returned: 0 in 0.187s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/452c1892-7356-487e-94e5-aaad1dbfb03f/disk. size=1073741824 {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452c1892-7356-487e-94e5-aaad1dbfb03f/disk --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG nova.network.neutron [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Successfully created port: 7f023c30-082d-47b6-ba3b-deacef8b3116 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/452c1892-7356-487e-94e5-aaad1dbfb03f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG nova.virt.disk.api [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Cannot resize image /opt/stack/data/nova/instances/452c1892-7356-487e-94e5-aaad1dbfb03f/disk to a smaller size. {{(pid=73091) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG nova.objects.instance [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lazy-loading 'migration_context' on Instance uuid 452c1892-7356-487e-94e5-aaad1dbfb03f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Ensure instance console log exists: /opt/stack/data/nova/instances/452c1892-7356-487e-94e5-aaad1dbfb03f/console.log {{(pid=73091) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:35 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Successfully updated port: 7f023c30-082d-47b6-ba3b-deacef8b3116 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquiring lock "refresh_cache-452c1892-7356-487e-94e5-aaad1dbfb03f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Acquired lock "refresh_cache-452c1892-7356-487e-94e5-aaad1dbfb03f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-7d0a0002-39c7-4a98-b0dc-b426b4281060 req-39972dee-cd92-4679-8be5-1adf03ac0cd1 service nova] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Received event network-changed-7f023c30-082d-47b6-ba3b-deacef8b3116 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.compute.manager [req-7d0a0002-39c7-4a98-b0dc-b426b4281060 req-39972dee-cd92-4679-8be5-1adf03ac0cd1 service nova] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Refreshing instance network info cache due to event network-changed-7f023c30-082d-47b6-ba3b-deacef8b3116. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7d0a0002-39c7-4a98-b0dc-b426b4281060 req-39972dee-cd92-4679-8be5-1adf03ac0cd1 service nova] Acquiring lock "refresh_cache-452c1892-7356-487e-94e5-aaad1dbfb03f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.network.neutron [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Updating instance_info_cache with network_info: [{"id": "7f023c30-082d-47b6-ba3b-deacef8b3116", "address": "fa:16:3e:0c:2d:e0", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f023c30-08", "ovs_interfaceid": "7f023c30-082d-47b6-ba3b-deacef8b3116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Releasing lock "refresh_cache-452c1892-7356-487e-94e5-aaad1dbfb03f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.compute.manager [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Instance network_info: |[{"id": "7f023c30-082d-47b6-ba3b-deacef8b3116", "address": "fa:16:3e:0c:2d:e0", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f023c30-08", "ovs_interfaceid": "7f023c30-082d-47b6-ba3b-deacef8b3116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7d0a0002-39c7-4a98-b0dc-b426b4281060 req-39972dee-cd92-4679-8be5-1adf03ac0cd1 service nova] Acquired lock "refresh_cache-452c1892-7356-487e-94e5-aaad1dbfb03f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.network.neutron [req-7d0a0002-39c7-4a98-b0dc-b426b4281060 req-39972dee-cd92-4679-8be5-1adf03ac0cd1 service nova] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Refreshing network info cache for port 7f023c30-082d-47b6-ba3b-deacef8b3116 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Start _get_guest_xml network_info=[{"id": "7f023c30-082d-47b6-ba3b-deacef8b3116", "address": "fa:16:3e:0c:2d:e0", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f023c30-08", "ovs_interfaceid": "7f023c30-082d-47b6-ba3b-deacef8b3116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:19:36 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:19:36 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-579070805',display_name='tempest-AttachVolumeNegativeTest-server-579070805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-579070805',id=26,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2begRozuxFP8oPMgBVTkSq/wuIarkTdyzlAHDd/E5m8u3Ud/skplde/G2dLYnEH6C0c475ZMQJ2t81tcxInapLs+sOI4ns8SkSwezyAdIAdFLB2ZI0tK9rMxt8KWwuYg==',key_name='tempest-keypair-505066131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8186c961465c48fc800e3b1ecd4ed077',ramdisk_id='',reservation_id='r-nd36ccj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1216940805',owner_user_name='tempest-AttachVolumeNegativeTest-1216940805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='741b35d305b340bfb00ecffb56a143b8',uuid=452c1892-7356-487e-94e5-aaad1dbfb03f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f023c30-082d-47b6-ba3b-deacef8b3116", "address": "fa:16:3e:0c:2d:e0", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f023c30-08", "ovs_interfaceid": "7f023c30-082d-47b6-ba3b-deacef8b3116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converting VIF {"id": "7f023c30-082d-47b6-ba3b-deacef8b3116", "address": "fa:16:3e:0c:2d:e0", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f023c30-08", "ovs_interfaceid": "7f023c30-082d-47b6-ba3b-deacef8b3116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:2d:e0,bridge_name='br-int',has_traffic_filtering=True,id=7f023c30-082d-47b6-ba3b-deacef8b3116,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f023c30-08') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.objects.instance [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lazy-loading 'pci_devices' on Instance uuid 452c1892-7356-487e-94e5-aaad1dbfb03f {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:19:36 user nova-compute[73091]:   <uuid>452c1892-7356-487e-94e5-aaad1dbfb03f</uuid>
Aug 16 08:19:36 user nova-compute[73091]:   <name>instance-0000001a</name>
Aug 16 08:19:36 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:19:36 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:19:36 user nova-compute[73091]:   <metadata>
Aug 16 08:19:36 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:19:36 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:19:36 user nova-compute[73091]:       <nova:name>tempest-AttachVolumeNegativeTest-server-579070805</nova:name>
Aug 16 08:19:36 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:19:36</nova:creationTime>
Aug 16 08:19:36 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:19:36 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:19:36 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:19:36 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:19:36 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:19:36 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:19:36 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:19:36 user nova-compute[73091]:       <nova:owner>
Aug 16 08:19:36 user nova-compute[73091]:         <nova:user uuid="741b35d305b340bfb00ecffb56a143b8">tempest-AttachVolumeNegativeTest-1216940805-project-member</nova:user>
Aug 16 08:19:36 user nova-compute[73091]:         <nova:project uuid="8186c961465c48fc800e3b1ecd4ed077">tempest-AttachVolumeNegativeTest-1216940805</nova:project>
Aug 16 08:19:36 user nova-compute[73091]:       </nova:owner>
Aug 16 08:19:36 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:19:36 user nova-compute[73091]:       <nova:ports>
Aug 16 08:19:36 user nova-compute[73091]:         <nova:port uuid="7f023c30-082d-47b6-ba3b-deacef8b3116">
Aug 16 08:19:36 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 08:19:36 user nova-compute[73091]:         </nova:port>
Aug 16 08:19:36 user nova-compute[73091]:       </nova:ports>
Aug 16 08:19:36 user nova-compute[73091]:     </nova:instance>
Aug 16 08:19:36 user nova-compute[73091]:   </metadata>
Aug 16 08:19:36 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:19:36 user nova-compute[73091]:     <system>
Aug 16 08:19:36 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:19:36 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:19:36 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:19:36 user nova-compute[73091]:       <entry name="serial">452c1892-7356-487e-94e5-aaad1dbfb03f</entry>
Aug 16 08:19:36 user nova-compute[73091]:       <entry name="uuid">452c1892-7356-487e-94e5-aaad1dbfb03f</entry>
Aug 16 08:19:36 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:19:36 user nova-compute[73091]:     </system>
Aug 16 08:19:36 user nova-compute[73091]:   </sysinfo>
Aug 16 08:19:36 user nova-compute[73091]:   <os>
Aug 16 08:19:36 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:19:36 user nova-compute[73091]:     <boot dev="hd"/>
Aug 16 08:19:36 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:19:36 user nova-compute[73091]:   </os>
Aug 16 08:19:36 user nova-compute[73091]:   <features>
Aug 16 08:19:36 user nova-compute[73091]:     <acpi/>
Aug 16 08:19:36 user nova-compute[73091]:     <apic/>
Aug 16 08:19:36 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:19:36 user nova-compute[73091]:   </features>
Aug 16 08:19:36 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:19:36 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:19:36 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:19:36 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:19:36 user nova-compute[73091]:   </clock>
Aug 16 08:19:36 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:19:36 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:19:36 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:19:36 user nova-compute[73091]:   </cpu>
Aug 16 08:19:36 user nova-compute[73091]:   <devices>
Aug 16 08:19:36 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:19:36 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:19:36 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/452c1892-7356-487e-94e5-aaad1dbfb03f/disk"/>
Aug 16 08:19:36 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:19:36 user nova-compute[73091]:     </disk>
Aug 16 08:19:36 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:19:36 user nova-compute[73091]:       <mac address="fa:16:3e:0c:2d:e0"/>
Aug 16 08:19:36 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:19:36 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:19:36 user nova-compute[73091]:       <target dev="tap7f023c30-08"/>
Aug 16 08:19:36 user nova-compute[73091]:     </interface>
Aug 16 08:19:36 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:19:36 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/452c1892-7356-487e-94e5-aaad1dbfb03f/console.log" append="off"/>
Aug 16 08:19:36 user nova-compute[73091]:     </serial>
Aug 16 08:19:36 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:19:36 user nova-compute[73091]:     <video>
Aug 16 08:19:36 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:19:36 user nova-compute[73091]:     </video>
Aug 16 08:19:36 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:19:36 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:19:36 user nova-compute[73091]:     </rng>
Aug 16 08:19:36 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:19:36 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:19:36 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:19:36 user nova-compute[73091]:     </memballoon>
Aug 16 08:19:36 user nova-compute[73091]:   </devices>
Aug 16 08:19:36 user nova-compute[73091]: </domain>
Aug 16 08:19:36 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-579070805',display_name='tempest-AttachVolumeNegativeTest-server-579070805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-579070805',id=26,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2begRozuxFP8oPMgBVTkSq/wuIarkTdyzlAHDd/E5m8u3Ud/skplde/G2dLYnEH6C0c475ZMQJ2t81tcxInapLs+sOI4ns8SkSwezyAdIAdFLB2ZI0tK9rMxt8KWwuYg==',key_name='tempest-keypair-505066131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8186c961465c48fc800e3b1ecd4ed077',ramdisk_id='',reservation_id='r-nd36ccj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1216940805',owner_user_name='tempest-AttachVolumeNegativeTest-1216940805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='741b35d305b340bfb00ecffb56a143b8',uuid=452c1892-7356-487e-94e5-aaad1dbfb03f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f023c30-082d-47b6-ba3b-deacef8b3116", "address": "fa:16:3e:0c:2d:e0", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f023c30-08", "ovs_interfaceid": "7f023c30-082d-47b6-ba3b-deacef8b3116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converting VIF {"id": "7f023c30-082d-47b6-ba3b-deacef8b3116", "address": "fa:16:3e:0c:2d:e0", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f023c30-08", "ovs_interfaceid": "7f023c30-082d-47b6-ba3b-deacef8b3116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:2d:e0,bridge_name='br-int',has_traffic_filtering=True,id=7f023c30-082d-47b6-ba3b-deacef8b3116,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f023c30-08') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG os_vif [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:2d:e0,bridge_name='br-int',has_traffic_filtering=True,id=7f023c30-082d-47b6-ba3b-deacef8b3116,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f023c30-08') {{(pid=73091) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:36 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f023c30-08, may_exist=True, interface_attrs={}) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f023c30-08, col_values=(('external_ids', {'iface-id': '7f023c30-082d-47b6-ba3b-deacef8b3116', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:2d:e0', 'vm-uuid': '452c1892-7356-487e-94e5-aaad1dbfb03f'}),), if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:37 user nova-compute[73091]: INFO os_vif [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:2d:e0,bridge_name='br-int',has_traffic_filtering=True,id=7f023c30-082d-47b6-ba3b-deacef8b3116,network=Network(c84302de-974a-4c33-886e-dc993a775f63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f023c30-08')
Aug 16 08:19:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] No VIF found with MAC fa:16:3e:0c:2d:e0, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "6a927702-8a5e-47d8-99de-b049f20b29a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lazy-loading 'flavor' on Instance uuid 6a927702-8a5e-47d8-99de-b049f20b29a3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "6a927702-8a5e-47d8-99de-b049f20b29a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:37 user nova-compute[73091]: INFO nova.compute.manager [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Attaching volume c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 to /dev/vdb
Aug 16 08:19:37 user nova-compute[73091]: DEBUG os_brick.utils [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[be138e1a-f4ab-4606-87e2-26d7e6edad68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[300f4fc3-dcee-4e70-b6d3-f6be9e3092b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[461ff2f4-8fcb-4672-b957-770523a49757]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[553509ce-ed94-4bb7-bc77-5f4a9ef705ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:19:37 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1fd936-3b61-43b5-bcb5-ef982f777743]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG os_brick.utils [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Updating existing volume attachment record: 37ede192-2e8a-4a1d-87eb-7cb33ea699a8 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-7d0a0002-39c7-4a98-b0dc-b426b4281060 req-39972dee-cd92-4679-8be5-1adf03ac0cd1 service nova] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Updated VIF entry in instance network info cache for port 7f023c30-082d-47b6-ba3b-deacef8b3116. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG nova.network.neutron [req-7d0a0002-39c7-4a98-b0dc-b426b4281060 req-39972dee-cd92-4679-8be5-1adf03ac0cd1 service nova] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Updating instance_info_cache with network_info: [{"id": "7f023c30-082d-47b6-ba3b-deacef8b3116", "address": "fa:16:3e:0c:2d:e0", "network": {"id": "c84302de-974a-4c33-886e-dc993a775f63", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-944404885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8186c961465c48fc800e3b1ecd4ed077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f023c30-08", "ovs_interfaceid": "7f023c30-082d-47b6-ba3b-deacef8b3116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:19:37 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-7d0a0002-39c7-4a98-b0dc-b426b4281060 req-39972dee-cd92-4679-8be5-1adf03ac0cd1 service nova] Releasing lock "refresh_cache-452c1892-7356-487e-94e5-aaad1dbfb03f" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:19:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:38 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-ccb957cc-cfe2-4ea9-9f42-3586ccc514aa req-b97f020c-2460-4a61-94af-bfc5b7e9f728 service nova] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Received event network-vif-plugged-7f023c30-082d-47b6-ba3b-deacef8b3116 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:19:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ccb957cc-cfe2-4ea9-9f42-3586ccc514aa req-b97f020c-2460-4a61-94af-bfc5b7e9f728 service nova] Acquiring lock "452c1892-7356-487e-94e5-aaad1dbfb03f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ccb957cc-cfe2-4ea9-9f42-3586ccc514aa req-b97f020c-2460-4a61-94af-bfc5b7e9f728 service nova] Lock "452c1892-7356-487e-94e5-aaad1dbfb03f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:38 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ccb957cc-cfe2-4ea9-9f42-3586ccc514aa req-b97f020c-2460-4a61-94af-bfc5b7e9f728 service nova] Lock "452c1892-7356-487e-94e5-aaad1dbfb03f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:38 user nova-compute[73091]: DEBUG nova.compute.manager [req-ccb957cc-cfe2-4ea9-9f42-3586ccc514aa req-b97f020c-2460-4a61-94af-bfc5b7e9f728 service nova] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] No waiting events found dispatching network-vif-plugged-7f023c30-082d-47b6-ba3b-deacef8b3116 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:19:38 user nova-compute[73091]: WARNING nova.compute.manager [req-ccb957cc-cfe2-4ea9-9f42-3586ccc514aa req-b97f020c-2460-4a61-94af-bfc5b7e9f728 service nova] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Received unexpected event network-vif-plugged-7f023c30-082d-47b6-ba3b-deacef8b3116 for instance with vm_state building and task_state spawning.
Aug 16 08:19:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:39 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173980.5693264, 452c1892-7356-487e-94e5-aaad1dbfb03f => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:19:40 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] VM Resumed (Lifecycle Event)
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Instance event wait completed in 0 seconds for  {{(pid=73091) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Guest created on hypervisor {{(pid=73091) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 08:19:40 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Instance spawned successfully.
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Found default for hw_cdrom_bus of ide {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Found default for hw_disk_bus of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Found default for hw_input_bus of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Found default for hw_pointer_model of None {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Found default for hw_video_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Found default for hw_vif_model of virtio {{(pid=73091) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 08:19:40 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692173980.5717492, 452c1892-7356-487e-94e5-aaad1dbfb03f => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:19:40 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] VM Started (Lifecycle Event)
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-de627cc6-756c-4c30-8426-4f6d5cb8ffa4 req-6d62a607-a88b-49da-833b-a04088a76566 service nova] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Received event network-vif-plugged-7f023c30-082d-47b6-ba3b-deacef8b3116 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-de627cc6-756c-4c30-8426-4f6d5cb8ffa4 req-6d62a607-a88b-49da-833b-a04088a76566 service nova] Acquiring lock "452c1892-7356-487e-94e5-aaad1dbfb03f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-de627cc6-756c-4c30-8426-4f6d5cb8ffa4 req-6d62a607-a88b-49da-833b-a04088a76566 service nova] Lock "452c1892-7356-487e-94e5-aaad1dbfb03f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-de627cc6-756c-4c30-8426-4f6d5cb8ffa4 req-6d62a607-a88b-49da-833b-a04088a76566 service nova] Lock "452c1892-7356-487e-94e5-aaad1dbfb03f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.compute.manager [req-de627cc6-756c-4c30-8426-4f6d5cb8ffa4 req-6d62a607-a88b-49da-833b-a04088a76566 service nova] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] No waiting events found dispatching network-vif-plugged-7f023c30-082d-47b6-ba3b-deacef8b3116 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:19:40 user nova-compute[73091]: WARNING nova.compute.manager [req-de627cc6-756c-4c30-8426-4f6d5cb8ffa4 req-6d62a607-a88b-49da-833b-a04088a76566 service nova] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Received unexpected event network-vif-plugged-7f023c30-082d-47b6-ba3b-deacef8b3116 for instance with vm_state building and task_state spawning.
Aug 16 08:19:40 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 08:19:40 user nova-compute[73091]: INFO nova.compute.manager [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 16 08:19:40 user nova-compute[73091]: DEBUG nova.compute.manager [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:19:40 user nova-compute[73091]: INFO nova.compute.manager [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] [instance: 452c1892-7356-487e-94e5-aaad1dbfb03f] Took 7.42 seconds to build instance.
Aug 16 08:19:40 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-bd6560ef-296c-4d88-880a-7ed6f94ba6da tempest-AttachVolumeNegativeTest-1216940805 tempest-AttachVolumeNegativeTest-1216940805-project-member] Lock "452c1892-7356-487e-94e5-aaad1dbfb03f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.561s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:42 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:44 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-c875d5ff-0459-4f91-a8e5-39e1ddf6ef88 req-1b99bc99-db9d-421e-b898-0d15dbf95114 service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Received event network-changed-517d5e72-8716-47bd-87b3-e61fcc3b1257 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:19:45 user nova-compute[73091]: DEBUG nova.compute.manager [req-c875d5ff-0459-4f91-a8e5-39e1ddf6ef88 req-1b99bc99-db9d-421e-b898-0d15dbf95114 service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Refreshing instance network info cache due to event network-changed-517d5e72-8716-47bd-87b3-e61fcc3b1257. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:19:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c875d5ff-0459-4f91-a8e5-39e1ddf6ef88 req-1b99bc99-db9d-421e-b898-0d15dbf95114 service nova] Acquiring lock "refresh_cache-4bfc7896-7001-48e3-a768-1030c3eb8485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:19:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c875d5ff-0459-4f91-a8e5-39e1ddf6ef88 req-1b99bc99-db9d-421e-b898-0d15dbf95114 service nova] Acquired lock "refresh_cache-4bfc7896-7001-48e3-a768-1030c3eb8485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:19:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-c875d5ff-0459-4f91-a8e5-39e1ddf6ef88 req-1b99bc99-db9d-421e-b898-0d15dbf95114 service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Refreshing network info cache for port 517d5e72-8716-47bd-87b3-e61fcc3b1257 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:19:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Acquiring lock "4bfc7896-7001-48e3-a768-1030c3eb8485" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "4bfc7896-7001-48e3-a768-1030c3eb8485" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:45 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lazy-loading 'flavor' on Instance uuid 4bfc7896-7001-48e3-a768-1030c3eb8485 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "4bfc7896-7001-48e3-a768-1030c3eb8485" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-c875d5ff-0459-4f91-a8e5-39e1ddf6ef88 req-1b99bc99-db9d-421e-b898-0d15dbf95114 service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Updated VIF entry in instance network info cache for port 517d5e72-8716-47bd-87b3-e61fcc3b1257. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:19:45 user nova-compute[73091]: DEBUG nova.network.neutron [req-c875d5ff-0459-4f91-a8e5-39e1ddf6ef88 req-1b99bc99-db9d-421e-b898-0d15dbf95114 service nova] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Updating instance_info_cache with network_info: [{"id": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "address": "fa:16:3e:bf:58:1a", "network": {"id": "6beb82b7-1250-42a3-8a36-5c0eb0f52f8f", "bridge": "br-int", "label": "tempest-TestStampPattern-1309048302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f10cfd89a8bc47518de5a75998ab8ade", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517d5e72-87", "ovs_interfaceid": "517d5e72-8716-47bd-87b3-e61fcc3b1257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:19:45 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-c875d5ff-0459-4f91-a8e5-39e1ddf6ef88 req-1b99bc99-db9d-421e-b898-0d15dbf95114 service nova] Releasing lock "refresh_cache-4bfc7896-7001-48e3-a768-1030c3eb8485" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Acquiring lock "4bfc7896-7001-48e3-a768-1030c3eb8485" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "4bfc7896-7001-48e3-a768-1030c3eb8485" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:46 user nova-compute[73091]: INFO nova.compute.manager [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Attaching volume 616890be-d8a8-42d8-a7e1-5f2fc973b616 to /dev/vdb
Aug 16 08:19:46 user nova-compute[73091]: DEBUG os_brick.utils [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb4cdbe-1469-4ac7-904a-973619abe5ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cb33ea59ee1f\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[027012f0-9909-442a-980c-9a6b7e4aba69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c154616c-7d82-447a-8f1f-9ce570e1abe0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[727f0a34-3572-4dc6-ba6b-ff6dca2d4cc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Running cmd (subprocess): nvme version {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] 'nvme version' failed. Not Retrying. {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] nvme not present on system {{(pid=73091) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 08:19:46 user nova-compute[73091]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4671fbed-679a-4bf1-ace5-746b2ba6b520]: (4, '') {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73091) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.lightos [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] LIGHTOS: no hostnqn found. {{(pid=73091) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG os_brick.utils [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cb33ea59ee1f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG nova.virt.block_device [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Updating existing volume attachment record: d2ec1959-d3d7-44ac-bf5f-3c3b0636d739 {{(pid=73091) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "935af9fd-600a-4c48-873b-b39126081748" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "935af9fd-600a-4c48-873b-b39126081748" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "935af9fd-600a-4c48-873b-b39126081748-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "935af9fd-600a-4c48-873b-b39126081748-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:46 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "935af9fd-600a-4c48-873b-b39126081748-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:46 user nova-compute[73091]: INFO nova.compute.manager [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Terminating instance
Aug 16 08:19:47 user nova-compute[73091]: DEBUG nova.compute.manager [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-555569a3-5156-4d57-8244-dda35f670c7e req-cc38f09e-87ad-469a-a5c5-535995d3893a service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Received event network-vif-unplugged-89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-555569a3-5156-4d57-8244-dda35f670c7e req-cc38f09e-87ad-469a-a5c5-535995d3893a service nova] Acquiring lock "935af9fd-600a-4c48-873b-b39126081748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-555569a3-5156-4d57-8244-dda35f670c7e req-cc38f09e-87ad-469a-a5c5-535995d3893a service nova] Lock "935af9fd-600a-4c48-873b-b39126081748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-555569a3-5156-4d57-8244-dda35f670c7e req-cc38f09e-87ad-469a-a5c5-535995d3893a service nova] Lock "935af9fd-600a-4c48-873b-b39126081748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-555569a3-5156-4d57-8244-dda35f670c7e req-cc38f09e-87ad-469a-a5c5-535995d3893a service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] No waiting events found dispatching network-vif-unplugged-89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG nova.compute.manager [req-555569a3-5156-4d57-8244-dda35f670c7e req-cc38f09e-87ad-469a-a5c5-535995d3893a service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Received event network-vif-unplugged-89db23e2-7d11-40dc-8403-4b0ccbc968de for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:19:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 935af9fd-600a-4c48-873b-b39126081748] Instance destroyed successfully.
Aug 16 08:19:47 user nova-compute[73091]: DEBUG nova.objects.instance [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lazy-loading 'resources' on Instance uuid 935af9fd-600a-4c48-873b-b39126081748 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:13:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1638336219',display_name='tempest-VolumesAdminNegativeTest-server-1638336219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1638336219',id=16,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOd3AtDA5xEO6EP+ZK1IVxaUX/eC3damMarqsWPunQGu1OhKEsQd3zawBvy8/ARjb7Tthlpp2gj4H029c62dlmtQ5Hn6MpmtVYY45WvPTkadR39xr1yzp/jyCYBTG4hZkA==',key_name='tempest-keypair-1803670635',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:13:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84db3210bb264fa8a51ff058417879cf',ramdisk_id='',reservation_id='r-kxyoav4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-285658015',owner_user_name='tempest-VolumesAdminNegativeTest-285658015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:13:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='193403aa9c4549cd936453ab6ef9c1d1',uuid=935af9fd-600a-4c48-873b-b39126081748,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "address": "fa:16:3e:33:9d:17", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89db23e2-7d", "ovs_interfaceid": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Converting VIF {"id": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "address": "fa:16:3e:33:9d:17", "network": {"id": "323e7b6f-721c-4ee0-aa42-fea90e1b7e97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1660025806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84db3210bb264fa8a51ff058417879cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89db23e2-7d", "ovs_interfaceid": "89db23e2-7d11-40dc-8403-4b0ccbc968de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:9d:17,bridge_name='br-int',has_traffic_filtering=True,id=89db23e2-7d11-40dc-8403-4b0ccbc968de,network=Network(323e7b6f-721c-4ee0-aa42-fea90e1b7e97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89db23e2-7d') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG os_vif [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:9d:17,bridge_name='br-int',has_traffic_filtering=True,id=89db23e2-7d11-40dc-8403-4b0ccbc968de,network=Network(323e7b6f-721c-4ee0-aa42-fea90e1b7e97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89db23e2-7d') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89db23e2-7d, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:47 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:19:47 user nova-compute[73091]: INFO os_vif [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:9d:17,bridge_name='br-int',has_traffic_filtering=True,id=89db23e2-7d11-40dc-8403-4b0ccbc968de,network=Network(323e7b6f-721c-4ee0-aa42-fea90e1b7e97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89db23e2-7d')
Aug 16 08:19:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Deleting instance files /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748_del
Aug 16 08:19:47 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Deletion of /opt/stack/data/nova/instances/935af9fd-600a-4c48-873b-b39126081748_del complete
Aug 16 08:19:48 user nova-compute[73091]: INFO nova.compute.manager [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] [instance: 935af9fd-600a-4c48-873b-b39126081748] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 16 08:19:48 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 08:19:48 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 935af9fd-600a-4c48-873b-b39126081748] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 08:19:48 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 935af9fd-600a-4c48-873b-b39126081748] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 935af9fd-600a-4c48-873b-b39126081748] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-4497f02d-257b-489e-bef1-6034fb86c65a req-f159a20b-b75e-4198-88d3-e381618737f5 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Received event network-vif-deleted-89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:19:49 user nova-compute[73091]: INFO nova.compute.manager [req-4497f02d-257b-489e-bef1-6034fb86c65a req-f159a20b-b75e-4198-88d3-e381618737f5 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Neutron deleted interface 89db23e2-7d11-40dc-8403-4b0ccbc968de; detaching it from the instance and deleting it from the info cache
Aug 16 08:19:49 user nova-compute[73091]: DEBUG nova.network.neutron [req-4497f02d-257b-489e-bef1-6034fb86c65a req-f159a20b-b75e-4198-88d3-e381618737f5 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:19:49 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 935af9fd-600a-4c48-873b-b39126081748] Took 1.19 seconds to deallocate network for instance.
Aug 16 08:19:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-4497f02d-257b-489e-bef1-6034fb86c65a req-f159a20b-b75e-4198-88d3-e381618737f5 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Detach interface failed, port_id=89db23e2-7d11-40dc-8403-4b0ccbc968de, reason: Instance 935af9fd-600a-4c48-873b-b39126081748 could not be found. {{(pid=73091) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Refreshing inventories for resource provider a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Updating ProviderTree inventory for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Updating inventory in ProviderTree for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Refreshing aggregate associations for resource provider a5935d1e-4613-4ec5-92d3-58605923e4b9, aggregates: None {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Refreshing trait associations for resource provider a5935d1e-4613-4ec5-92d3-58605923e4b9, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING {{(pid=73091) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce58f4c4-47fd-4a1b-b8c5-524ece3a69c2 req-83cfee73-4ea2-4dba-a65e-23f80fe40ab0 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Received event network-vif-plugged-89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce58f4c4-47fd-4a1b-b8c5-524ece3a69c2 req-83cfee73-4ea2-4dba-a65e-23f80fe40ab0 service nova] Acquiring lock "935af9fd-600a-4c48-873b-b39126081748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce58f4c4-47fd-4a1b-b8c5-524ece3a69c2 req-83cfee73-4ea2-4dba-a65e-23f80fe40ab0 service nova] Lock "935af9fd-600a-4c48-873b-b39126081748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ce58f4c4-47fd-4a1b-b8c5-524ece3a69c2 req-83cfee73-4ea2-4dba-a65e-23f80fe40ab0 service nova] Lock "935af9fd-600a-4c48-873b-b39126081748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG nova.compute.manager [req-ce58f4c4-47fd-4a1b-b8c5-524ece3a69c2 req-83cfee73-4ea2-4dba-a65e-23f80fe40ab0 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] No waiting events found dispatching network-vif-plugged-89db23e2-7d11-40dc-8403-4b0ccbc968de {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:19:49 user nova-compute[73091]: WARNING nova.compute.manager [req-ce58f4c4-47fd-4a1b-b8c5-524ece3a69c2 req-83cfee73-4ea2-4dba-a65e-23f80fe40ab0 service nova] [instance: 935af9fd-600a-4c48-873b-b39126081748] Received unexpected event network-vif-plugged-89db23e2-7d11-40dc-8403-4b0ccbc968de for instance with vm_state deleted and task_state None.
Aug 16 08:19:49 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:19:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.579s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:49 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Deleted allocations for instance 935af9fd-600a-4c48-873b-b39126081748
Aug 16 08:19:49 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-16eecf76-994f-4a19-bf7a-c779452f9e76 tempest-VolumesAdminNegativeTest-285658015 tempest-VolumesAdminNegativeTest-285658015-project-member] Lock "935af9fd-600a-4c48-873b-b39126081748" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.013s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:52 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwRtLGHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:19:53 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:19:53 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:19:53 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb40aed-74df-4b36-b464-5cb9ced3f93a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:19:53 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4381cad7-4f19-41d9-af68-617963865605]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4] added
Aug 16 08:19:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c45eca8-4988-4314-8393-6b045541b8b1]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30c15eb-08ea-4e84-a660-50d6d6ca28c0]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwRtLGHb {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwRtLGHb" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc77dbe-8831-442a-b6be-2524fba9eb62]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lwRtLGHb'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6e1977-0b4c-4324-a37c-7b7572417dd6]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83dafe3-bace-4fb2-9b26-f37cbef28002]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:53 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:53 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:53 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:53 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53029e2-3798-4f79-a2a7-d5ffb88c0a98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4, portal: 172.16.0.220,3260]
Aug 16 08:19:53 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4, portal: 172.16.0.220,3260] successful.
Aug 16 08:19:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53799e7-5a6b-4984-83e1-2d1b293ab49c]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d9aea0-362e-4eaf-8fe4-5a72179f500b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:53 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:53 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:53 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)
Aug 16 08:19:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:53 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:53 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:53 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)
Aug 16 08:19:53 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0227a293-d74e-49f6-b098-f935998ff98d]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:19:53 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwRtLGHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:19:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:19:54 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23233303732343736', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:19:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233303732343736', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:19:54 user nova-compute[73091]: DEBUG nova.objects.instance [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lazy-loading 'flavor' on Instance uuid 6a927702-8a5e-47d8-99de-b049f20b29a3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 08:19:54 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:19:54 user nova-compute[73091]:   <source dev="/dev/sdc"/>
Aug 16 08:19:54 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:19:54 user nova-compute[73091]:   <serial>c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4</serial>
Aug 16 08:19:54 user nova-compute[73091]: </disk>
Aug 16 08:19:54 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 08:19:54 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:19:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:19:54 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] No VIF found with MAC fa:16:3e:d1:2f:86, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-1739946a-07b2-481c-8e32-127740b23e17 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.751s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:55 user nova-compute[73091]: INFO nova.compute.manager [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Rescuing
Aug 16 08:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "refresh_cache-6a927702-8a5e-47d8-99de-b049f20b29a3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:19:55 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquired lock "refresh_cache-6a927702-8a5e-47d8-99de-b049f20b29a3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:19:55 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCIkXSeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:19:56 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:19:56 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:19:56 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad7b35c-2aa0-45c6-88e8-26dd0dde5491]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 08:19:56 user nova-compute[73091]:  {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --interface default --op new {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d364e894-fb26-4188-88fb-5457c8efdbaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616] added\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616] added
Aug 16 08:19:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[91abf33b-6b48-40a9-94d8-a84c7ccd9034]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e34b4cd-5e14-40e7-a9a9-ccf44f21ddef]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCIkXSeY {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCIkXSeY" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[487fe2e0-b7c0-4307-879a-4ef213d2045a]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OCIkXSeY'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[7284535a-cd45-4ed0-9a9d-801ff427171b]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a93d591-d1bd-4281-a6ae-b757c99470b7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:56 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:56 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:56 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)
Aug 16 08:19:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:56 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:56 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:56 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)
Aug 16 08:19:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --login {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbb0b67-362e-442a-a649-f17efed7453d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616, portal: 172.16.0.220,3260]
Aug 16 08:19:56 user nova-compute[73091]: Login to [iface: default, target: iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616, portal: 172.16.0.220,3260] successful.
Aug 16 08:19:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[387af2ed-8a8d-46a9-ad02-774b1810c9df]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb9655d-00d0-44c5-b3a8-2f1529955b0d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:56 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:56 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:56 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)
Aug 16 08:19:56 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 (non-flash)
Aug 16 08:19:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:56 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:56 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:56 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)
Aug 16 08:19:56 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 (non-flash)
Aug 16 08:19:56 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.470s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bd66b8-bd29-4150-856a-1777231fb6c3]: (4, ('- - 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCIkXSeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG nova.network.neutron [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Updating instance_info_cache with network_info: [{"id": "2334292e-6adb-4800-a26e-26c91045e0f2", "address": "fa:16:3e:d1:2f:86", "network": {"id": "ff14bf7f-3994-42a9-8de1-5426de17b16d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bd6561008748148418f8a5a3e3d382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2334292e-6a", "ovs_interfaceid": "2334292e-6adb-4800-a26e-26c91045e0f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Releasing lock "refresh_cache-6a927702-8a5e-47d8-99de-b049f20b29a3" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:56 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-b8b7b4dd-3640-4d58-9991-ab1266683762 req-c46833b7-4a6e-4340-a391-58d56a87d5d8 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Received event network-vif-unplugged-2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8b7b4dd-3640-4d58-9991-ab1266683762 req-c46833b7-4a6e-4340-a391-58d56a87d5d8 service nova] Acquiring lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8b7b4dd-3640-4d58-9991-ab1266683762 req-c46833b7-4a6e-4340-a391-58d56a87d5d8 service nova] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-b8b7b4dd-3640-4d58-9991-ab1266683762 req-c46833b7-4a6e-4340-a391-58d56a87d5d8 service nova] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG nova.compute.manager [req-b8b7b4dd-3640-4d58-9991-ab1266683762 req-c46833b7-4a6e-4340-a391-58d56a87d5d8 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] No waiting events found dispatching network-vif-unplugged-2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:19:57 user nova-compute[73091]: WARNING nova.compute.manager [req-b8b7b4dd-3640-4d58-9991-ab1266683762 req-c46833b7-4a6e-4340-a391-58d56a87d5d8 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Received unexpected event network-vif-unplugged-2334292e-6adb-4800-a26e-26c91045e0f2 for instance with vm_state active and task_state rescuing.
Aug 16 08:19:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Instance destroyed successfully.
Aug 16 08:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Acquiring lock "9a2dd138-1c20-4114-afac-e272aba39537" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "9a2dd138-1c20-4114-afac-e272aba39537" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Acquiring lock "9a2dd138-1c20-4114-afac-e272aba39537-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "9a2dd138-1c20-4114-afac-e272aba39537-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "9a2dd138-1c20-4114-afac-e272aba39537-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:57 user nova-compute[73091]: INFO nova.compute.manager [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Terminating instance
Aug 16 08:19:57 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 08:19:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Attempting a stable device rescue
Aug 16 08:19:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73091) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Instance directory exists: not creating {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 08:19:57 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Creating image(s)
Aug 16 08:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "/opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "/opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a927702-8a5e-47d8-99de-b049f20b29a3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.510s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] <== connect_volume: return (1512ms) {'type': 'block', 'scsi_wwn': '23433313366623031', 'path': '/dev/sdf'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433313366623031', 'path': '/dev/sdf'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG nova.objects.instance [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lazy-loading 'flavor' on Instance uuid 4bfc7896-7001-48e3-a768-1030c3eb8485 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:57 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 08:19:57 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:19:57 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 08:19:57 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:19:57 user nova-compute[73091]:   <serial>616890be-d8a8-42d8-a7e1-5f2fc973b616</serial>
Aug 16 08:19:57 user nova-compute[73091]: </disk>
Aug 16 08:19:57 user nova-compute[73091]:  {{(pid=73091) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8.part --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-6aef5950-55fe-4079-af86-855a4c5e6779 req-2b3a5db5-47c7-449e-8604-374864efd7a1 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Received event network-vif-unplugged-4dd5faac-d8ed-41ca-9160-c72beda8f636 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6aef5950-55fe-4079-af86-855a4c5e6779 req-2b3a5db5-47c7-449e-8604-374864efd7a1 service nova] Acquiring lock "9a2dd138-1c20-4114-afac-e272aba39537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6aef5950-55fe-4079-af86-855a4c5e6779 req-2b3a5db5-47c7-449e-8604-374864efd7a1 service nova] Lock "9a2dd138-1c20-4114-afac-e272aba39537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6aef5950-55fe-4079-af86-855a4c5e6779 req-2b3a5db5-47c7-449e-8604-374864efd7a1 service nova] Lock "9a2dd138-1c20-4114-afac-e272aba39537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-6aef5950-55fe-4079-af86-855a4c5e6779 req-2b3a5db5-47c7-449e-8604-374864efd7a1 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] No waiting events found dispatching network-vif-unplugged-4dd5faac-d8ed-41ca-9160-c72beda8f636 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG nova.compute.manager [req-6aef5950-55fe-4079-af86-855a4c5e6779 req-2b3a5db5-47c7-449e-8604-374864efd7a1 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Received event network-vif-unplugged-4dd5faac-d8ed-41ca-9160-c72beda8f636 for instance with task_state deleting. {{(pid=73091) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 08:19:58 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Instance destroyed successfully.
Aug 16 08:19:58 user nova-compute[73091]: DEBUG nova.objects.instance [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lazy-loading 'resources' on Instance uuid 9a2dd138-1c20-4114-afac-e272aba39537 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1726819447',display_name='tempest-TestVolumeBootPattern-server-1726819447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1726819447',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:18:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe7114778fe940f4a40e3bbc9e1330ee',ramdisk_id='',reservation_id='r-n8h0zek0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1306800265',owner_user_name='tempest-TestVolumeBootPattern-1306800265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T08:18:34Z,user_data=None,user_id='e76fe91d0ac44c0caf12d70bc2a1a0f6',uuid=9a2dd138-1c20-4114-afac-e272aba39537,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "address": "fa:16:3e:8f:1a:51", "network": {"id": "cf1256b4-483b-4865-b7d3-66bdd6688483", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1119826949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7114778fe940f4a40e3bbc9e1330ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd5faac-d8", "ovs_interfaceid": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Converting VIF {"id": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "address": "fa:16:3e:8f:1a:51", "network": {"id": "cf1256b4-483b-4865-b7d3-66bdd6688483", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1119826949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7114778fe940f4a40e3bbc9e1330ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd5faac-d8", "ovs_interfaceid": "4dd5faac-d8ed-41ca-9160-c72beda8f636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=4dd5faac-d8ed-41ca-9160-c72beda8f636,network=Network(cf1256b4-483b-4865-b7d3-66bdd6688483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dd5faac-d8') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG os_vif [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=4dd5faac-d8ed-41ca-9160-c72beda8f636,network=Network(cf1256b4-483b-4865-b7d3-66bdd6688483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dd5faac-d8') {{(pid=73091) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dd5faac-d8, bridge=br-int, if_exists=True) {{(pid=73091) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] No VIF found with MAC fa:16:3e:bf:58:1a, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:58 user nova-compute[73091]: INFO os_vif [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=4dd5faac-d8ed-41ca-9160-c72beda8f636,network=Network(cf1256b4-483b-4865-b7d3-66bdd6688483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dd5faac-d8')
Aug 16 08:19:58 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFneqohD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:19:58 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:19:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ec7b0b-1663-432d-8078-4956628b20f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8.part --force-share --output=json" returned: 0 in 0.181s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG nova.virt.images [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] e453ae34-ae65-4a17-a3bc-21bff329bbed was qcow2, converting to raw {{(pid=73091) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG nova.privsep.utils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73091) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8.part /opt/stack/data/nova/instances/_base/ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8.converted {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68586d1-97f1-48b1-a6cb-1e72a1a75e04]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:58 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:58 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:58 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)
Aug 16 08:19:58 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 (non-flash)
Aug 16 08:19:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:58 user nova-compute[73091]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d (non-flash)
Aug 16 08:19:58 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:58 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)
Aug 16 08:19:58 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 (non-flash)
Aug 16 08:19:58 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8cc4cd090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d'): ({'sdd'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Removing single pathed devices sdd {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d823103-5892-4b10-a402-3e94c2876d2d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-5ee86e0f-6c61-4e50-96dc-5dea25f33de9 tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "4bfc7896-7001-48e3-a768-1030c3eb8485" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.897s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:58 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92e36d2-0e51-4f77-a467-63b4dfc3502f]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Flushing IO for device /dev/sdd {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b87212-1a1e-4a61-8f6e-4852dc673a32]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.082s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a811ae-1115-48ef-96dd-99de08f3cf3b]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] SCSI volumes sdd have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8.part /opt/stack/data/nova/instances/_base/ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8.converted" returned: 0 in 0.262s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8.converted --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cebef2a-6a77-49b9-8bec-0ceca17fe18f]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-ba9d84b4-b8df-4314-a22f-fbf98050b9ef req-0d27a2e9-c9f1-4d5d-89bd-04f28f3a08b1 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Received event network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ba9d84b4-b8df-4314-a22f-fbf98050b9ef req-0d27a2e9-c9f1-4d5d-89bd-04f28f3a08b1 service nova] Acquiring lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ba9d84b4-b8df-4314-a22f-fbf98050b9ef req-0d27a2e9-c9f1-4d5d-89bd-04f28f3a08b1 service nova] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-ba9d84b4-b8df-4314-a22f-fbf98050b9ef req-0d27a2e9-c9f1-4d5d-89bd-04f28f3a08b1 service nova] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.compute.manager [req-ba9d84b4-b8df-4314-a22f-fbf98050b9ef req-0d27a2e9-c9f1-4d5d-89bd-04f28f3a08b1 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] No waiting events found dispatching network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:19:59 user nova-compute[73091]: WARNING nova.compute.manager [req-ba9d84b4-b8df-4314-a22f-fbf98050b9ef req-0d27a2e9-c9f1-4d5d-89bd-04f28f3a08b1 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Received unexpected event network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 for instance with vm_state active and task_state rescuing.
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0baafbc-ae42-40e4-a2cf-9d61b9f40d41]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d, portal: 172.16.0.220,3260]
Aug 16 08:19:59 user nova-compute[73091]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d, portal: 172.16.0.220,3260] successful.
Aug 16 08:19:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d4c5143-c649-4a19-9aea-9189ea42c65d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b0c739-4406-4072-8205-c165e96b2018]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.479s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] <== disconnect_volume: return (480ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:19:59 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Deleting instance files /opt/stack/data/nova/instances/9a2dd138-1c20-4114-afac-e272aba39537_del
Aug 16 08:19:59 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Deletion of /opt/stack/data/nova/instances/9a2dd138-1c20-4114-afac-e272aba39537_del complete
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.726s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8 --force-share --output=json {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: INFO nova.compute.manager [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Took 1.86 seconds to destroy the instance on the hypervisor.
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo.service.loopingcall [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73091) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.compute.manager [-] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Deallocating network for instance {{(pid=73091) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] deallocate_for_instance() {{(pid=73091) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8 --force-share --output=json" returned: 0 in 0.174s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8,backing_fmt=raw /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk.rescue {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8,backing_fmt=raw /opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk.rescue" returned: 0 in 0.048s {{(pid=73091) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "ec0b59e81d9f221279c7ce6c2b616d7a63cfe3e8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lazy-loading 'migration_context' on Instance uuid 6a927702-8a5e-47d8-99de-b049f20b29a3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Created local disks {{(pid=73091) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Start _get_guest_xml network_info=[{"id": "2334292e-6adb-4800-a26e-26c91045e0f2", "address": "fa:16:3e:d1:2f:86", "network": {"id": "ff14bf7f-3994-42a9-8de1-5426de17b16d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "vif_mac": "fa:16:3e:d1:2f:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bd6561008748148418f8a5a3e3d382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2334292e-6a", "ovs_interfaceid": "2334292e-6adb-4800-a26e-26c91045e0f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e453ae34-ae65-4a17-a3bc-21bff329bbed', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'image_id': '9c570403-184d-4d84-97e0-b6d49d2e29e7'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'attachment_id': '37ede192-2e8a-4a1d-87eb-7cb33ea699a8', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwRtLGHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6a927702-8a5e-47d8-99de-b049f20b29a3', 'attached_at': '', 'detached_at': '', 'volume_id': 'c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4', 'serial': 'c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4'}, 'volume_type': None} {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lazy-loading 'resources' on Instance uuid 6a927702-8a5e-47d8-99de-b049f20b29a3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a927702-8a5e-47d8-99de-b049f20b29a3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:59 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:19:59 user nova-compute[73091]: WARNING nova.virt.libvirt.driver [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CPU controller missing on host. {{(pid=73091) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CPU controller found on host. {{(pid=73091) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73091) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T08:04:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=9c570403-184d-4d84-97e0-b6d49d2e29e7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='affe5e1e8bce4293b7c1080e3091cc8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Flavor limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Image limits 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Flavor pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Image pref 0:0:0 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Got 1 possible topologies {{(pid=73091) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73091) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a927702-8a5e-47d8-99de-b049f20b29a3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Calling os-brick to attach iSCSI Volume {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwRtLGHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:19:59 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:19:59 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:19:59 user nova-compute[73091]: INFO os_brick.initiator.connectors.iscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 08:19:59 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[b012d1e2-97e9-4d6d-9cf3-c1858d354678]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = lwRtLGHb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 08:19:59 user nova-compute[73091]: node.name = iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4
Aug 16 08:19:59 user nova-compute[73091]: node.tpgt = -1
Aug 16 08:19:59 user nova-compute[73091]: node.startup = automatic
Aug 16 08:19:59 user nova-compute[73091]: node.leading_login = No
Aug 16 08:19:59 user nova-compute[73091]: iface.iscsi_ifacename = default
Aug 16 08:19:59 user nova-compute[73091]: iface.net_ifacename = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.ipaddress = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.prefix_len = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.hwaddress = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.transport_name = tcp
Aug 16 08:19:59 user nova-compute[73091]: iface.initiatorname = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.state = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.vlan_id = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.vlan_priority = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.vlan_state = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.iface_num = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.mtu = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.port = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.bootproto = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.subnet_mask = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.gateway = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.dhcp_alt_client_id = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.dhcp_dns = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.dhcp_learn_iqn = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.dhcp_vendor_id_state = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.dhcp_vendor_id = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.dhcp_slp_da = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.fragmentation = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.gratuitous_arp = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.incoming_forwarding = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.tos_state = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.tos = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.ttl = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.delayed_ack = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.tcp_nagle = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.tcp_wsf_state = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.tcp_wsf = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.tcp_timer_scale = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.tcp_timestamp = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.redirect = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.def_task_mgmt_timeout = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.header_digest = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.data_digest = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.immediate_data = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.initial_r2t = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.data_seq_inorder = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.data_pdu_inorder = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.erl = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.max_receive_data_len = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.first_burst_len = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.max_outstanding_r2t = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.max_burst_len = 0
Aug 16 08:19:59 user nova-compute[73091]: iface.chap_auth = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.bidi_chap = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.strict_login_compliance = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.discovery_auth = <empty>
Aug 16 08:19:59 user nova-compute[73091]: iface.discovery_logout = <empty>
Aug 16 08:19:59 user nova-compute[73091]: node.discovery_address = <empty>
Aug 16 08:19:59 user nova-compute[73091]: node.discovery_port = 0
Aug 16 08:19:59 user nova-compute[73091]: node.discovery_type = static
Aug 16 08:19:59 user nova-compute[73091]: node.session.initial_cmdsn = 0
Aug 16 08:19:59 user nova-compute[73091]: node.session.initial_login_retry_max = 8
Aug 16 08:19:59 user nova-compute[73091]: node.session.xmit_thread_priority = -20
Aug 16 08:19:59 user nova-compute[73091]: node.session.cmds_max = 128
Aug 16 08:19:59 user nova-compute[73091]: node.session.queue_depth = 32
Aug 16 08:19:59 user nova-compute[73091]: node.session.nr_sessions = 1
Aug 16 08:19:59 user nova-compute[73091]: node.session.auth.authmethod = CHAP
Aug 16 08:19:59 user nova-compute[73091]: node.session.auth.username = lwRtLGHb
Aug 16 08:19:59 user nova-compute[73091]: node.session.auth.password = ***
Aug 16 08:19:59 user nova-compute[73091]: node.session.auth.username_in = <empty>
Aug 16 08:19:59 user nova-compute[73091]: node.session.auth.password_in = <empty>
Aug 16 08:19:59 user nova-compute[73091]: node.session.auth.chap_algs = MD5
Aug 16 08:19:59 user nova-compute[73091]: node.session.timeo.replacement_timeout = 120
Aug 16 08:19:59 user nova-compute[73091]: node.session.err_timeo.abort_timeout = 15
Aug 16 08:19:59 user nova-compute[73091]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 08:19:59 user nova-compute[73091]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 08:19:59 user nova-compute[73091]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 08:19:59 user nova-compute[73091]: node.session.iscsi.FastAbort = Yes
Aug 16 08:19:59 user nova-compute[73091]: node.session.iscsi.InitialR2T = No
Aug 16 08:19:59 user nova-compute[73091]: node.session.iscsi.ImmediateData = Yes
Aug 16 08:19:59 user nova-compute[73091]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 08:19:59 user nova-compute[73091]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 08:19:59 user nova-compute[73091]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 08:19:59 user nova-compute[73091]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 08:19:59 user nova-compute[73091]: node.session.iscsi.MaxConnections = 1
Aug 16 08:19:59 user nova-compute[73091]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 08:19:59 user nova-compute[73091]: node.session.iscsi.ERL = 0
Aug 16 08:19:59 user nova-compute[73091]: node.session.scan = manual
Aug 16 08:19:59 user nova-compute[73091]: node.session.reopen_max = 0
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].address = 172.16.0.220
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].port = 3260
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].startup = manual
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].tcp.window_size = 524288
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].tcp.type_of_service = 0
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].timeo.logout_timeout = 15
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].timeo.login_timeout = 15
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].timeo.auth_timeout = 45
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].iscsi.DataDigest = None
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].iscsi.IFMarker = No
Aug 16 08:19:59 user nova-compute[73091]: node.conn[0].iscsi.OFMarker = No
Aug 16 08:19:59 user nova-compute[73091]: # END RECORD
Aug 16 08:19:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bce2530-090b-4ecd-a0a4-4b1fdd22c435]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3624bac-08d5-4611-976a-ab1ec80d7bab]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwRtLGHb {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwRtLGHb" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[0555e736-786b-40bf-bf3d-46c70f5da629]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lwRtLGHb'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c89fe1e-8b06-4aaf-be77-1d617f107074]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8f7b4e-00fc-4ce5-a5ea-d7f997781614]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:59 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:59 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)
Aug 16 08:19:59 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 (non-flash)
Aug 16 08:19:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:19:59 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:19:59 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)
Aug 16 08:19:59 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 (non-flash)
Aug 16 08:19:59 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Connected to 172.16.0.220:3260 {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] HCTL ('34', '0', '0', 0) found on session 29 with lun 0 {{(pid=73091) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73091) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b81424d-8a61-478e-b8d8-a7b094667fb2]: (4, ('0 0 0', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Searching for a device in session 29 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73091) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwRtLGHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73091) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.175s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] <== connect_volume: return (177ms) {'type': 'block', 'scsi_wwn': '23233303732343736', 'path': '/dev/sdc'} {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233303732343736', 'path': '/dev/sdc'} {{(pid=73091) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.vif [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T08:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-543309518',display_name='tempest-ServerStableDeviceRescueTest-server-543309518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-543309518',id=18,image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRcYmUINnIDd6/hqv1bjm6pDkdjpEUwsMVKGIhxEX8tya/SP3djgUOn12AGt0LfCkaqLq5CNvztIC6i4ovP7l8mpWVmHo9U70ToNSekOgmL8P3jvuTzAOzdG2V7GZE0IQ==',key_name='tempest-keypair-1942242932',keypairs=<?>,launch_index=0,launched_at=2023-08-16T08:16:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0bd6561008748148418f8a5a3e3d382',ramdisk_id='',reservation_id='r-9xl9taq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c570403-184d-4d84-97e0-b6d49d2e29e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2133277169',owner_user_name='tempest-ServerStableDeviceRescueTest-2133277169-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T08:17:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063a618d02174a94a23674a2923acafb',uuid=6a927702-8a5e-47d8-99de-b049f20b29a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2334292e-6adb-4800-a26e-26c91045e0f2", "address": "fa:16:3e:d1:2f:86", "network": {"id": "ff14bf7f-3994-42a9-8de1-5426de17b16d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "vif_mac": "fa:16:3e:d1:2f:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bd6561008748148418f8a5a3e3d382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2334292e-6a", "ovs_interfaceid": "2334292e-6adb-4800-a26e-26c91045e0f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73091) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Converting VIF {"id": "2334292e-6adb-4800-a26e-26c91045e0f2", "address": "fa:16:3e:d1:2f:86", "network": {"id": "ff14bf7f-3994-42a9-8de1-5426de17b16d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1193082747-network", "vif_mac": "fa:16:3e:d1:2f:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bd6561008748148418f8a5a3e3d382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2334292e-6a", "ovs_interfaceid": "2334292e-6adb-4800-a26e-26c91045e0f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.network.os_vif_util [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2f:86,bridge_name='br-int',has_traffic_filtering=True,id=2334292e-6adb-4800-a26e-26c91045e0f2,network=Network(ff14bf7f-3994-42a9-8de1-5426de17b16d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2334292e-6a') {{(pid=73091) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.objects.instance [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a927702-8a5e-47d8-99de-b049f20b29a3 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 08:19:59 user nova-compute[73091]:   <uuid>6a927702-8a5e-47d8-99de-b049f20b29a3</uuid>
Aug 16 08:19:59 user nova-compute[73091]:   <name>instance-00000012</name>
Aug 16 08:19:59 user nova-compute[73091]:   <memory>524288</memory>
Aug 16 08:19:59 user nova-compute[73091]:   <vcpu>1</vcpu>
Aug 16 08:19:59 user nova-compute[73091]:   <metadata>
Aug 16 08:19:59 user nova-compute[73091]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 08:19:59 user nova-compute[73091]:       <nova:package version="0.0.0"/>
Aug 16 08:19:59 user nova-compute[73091]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-543309518</nova:name>
Aug 16 08:19:59 user nova-compute[73091]:       <nova:creationTime>2023-08-16 08:19:59</nova:creationTime>
Aug 16 08:19:59 user nova-compute[73091]:       <nova:flavor name="m1.tiny">
Aug 16 08:19:59 user nova-compute[73091]:         <nova:memory>512</nova:memory>
Aug 16 08:19:59 user nova-compute[73091]:         <nova:disk>1</nova:disk>
Aug 16 08:19:59 user nova-compute[73091]:         <nova:swap>0</nova:swap>
Aug 16 08:19:59 user nova-compute[73091]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 08:19:59 user nova-compute[73091]:         <nova:vcpus>1</nova:vcpus>
Aug 16 08:19:59 user nova-compute[73091]:       </nova:flavor>
Aug 16 08:19:59 user nova-compute[73091]:       <nova:owner>
Aug 16 08:19:59 user nova-compute[73091]:         <nova:user uuid="063a618d02174a94a23674a2923acafb">tempest-ServerStableDeviceRescueTest-2133277169-project-member</nova:user>
Aug 16 08:19:59 user nova-compute[73091]:         <nova:project uuid="f0bd6561008748148418f8a5a3e3d382">tempest-ServerStableDeviceRescueTest-2133277169</nova:project>
Aug 16 08:19:59 user nova-compute[73091]:       </nova:owner>
Aug 16 08:19:59 user nova-compute[73091]:       <nova:root type="image" uuid="9c570403-184d-4d84-97e0-b6d49d2e29e7"/>
Aug 16 08:19:59 user nova-compute[73091]:       <nova:ports>
Aug 16 08:19:59 user nova-compute[73091]:         <nova:port uuid="2334292e-6adb-4800-a26e-26c91045e0f2">
Aug 16 08:19:59 user nova-compute[73091]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 08:19:59 user nova-compute[73091]:         </nova:port>
Aug 16 08:19:59 user nova-compute[73091]:       </nova:ports>
Aug 16 08:19:59 user nova-compute[73091]:     </nova:instance>
Aug 16 08:19:59 user nova-compute[73091]:   </metadata>
Aug 16 08:19:59 user nova-compute[73091]:   <sysinfo type="smbios">
Aug 16 08:19:59 user nova-compute[73091]:     <system>
Aug 16 08:19:59 user nova-compute[73091]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 08:19:59 user nova-compute[73091]:       <entry name="product">OpenStack Nova</entry>
Aug 16 08:19:59 user nova-compute[73091]:       <entry name="version">0.0.0</entry>
Aug 16 08:19:59 user nova-compute[73091]:       <entry name="serial">6a927702-8a5e-47d8-99de-b049f20b29a3</entry>
Aug 16 08:19:59 user nova-compute[73091]:       <entry name="uuid">6a927702-8a5e-47d8-99de-b049f20b29a3</entry>
Aug 16 08:19:59 user nova-compute[73091]:       <entry name="family">Virtual Machine</entry>
Aug 16 08:19:59 user nova-compute[73091]:     </system>
Aug 16 08:19:59 user nova-compute[73091]:   </sysinfo>
Aug 16 08:19:59 user nova-compute[73091]:   <os>
Aug 16 08:19:59 user nova-compute[73091]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 08:19:59 user nova-compute[73091]:     <smbios mode="sysinfo"/>
Aug 16 08:19:59 user nova-compute[73091]:   </os>
Aug 16 08:19:59 user nova-compute[73091]:   <features>
Aug 16 08:19:59 user nova-compute[73091]:     <acpi/>
Aug 16 08:19:59 user nova-compute[73091]:     <apic/>
Aug 16 08:19:59 user nova-compute[73091]:     <vmcoreinfo/>
Aug 16 08:19:59 user nova-compute[73091]:   </features>
Aug 16 08:19:59 user nova-compute[73091]:   <clock offset="utc">
Aug 16 08:19:59 user nova-compute[73091]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 08:19:59 user nova-compute[73091]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 08:19:59 user nova-compute[73091]:     <timer name="hpet" present="no"/>
Aug 16 08:19:59 user nova-compute[73091]:   </clock>
Aug 16 08:19:59 user nova-compute[73091]:   <cpu mode="custom" match="exact">
Aug 16 08:19:59 user nova-compute[73091]:     <model>Nehalem</model>
Aug 16 08:19:59 user nova-compute[73091]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 08:19:59 user nova-compute[73091]:   </cpu>
Aug 16 08:19:59 user nova-compute[73091]:   <devices>
Aug 16 08:19:59 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:19:59 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:19:59 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk"/>
Aug 16 08:19:59 user nova-compute[73091]:       <target dev="vda" bus="virtio"/>
Aug 16 08:19:59 user nova-compute[73091]:     </disk>
Aug 16 08:19:59 user nova-compute[73091]:     <disk type="block" device="disk">
Aug 16 08:19:59 user nova-compute[73091]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:19:59 user nova-compute[73091]:       <source dev="/dev/sdc"/>
Aug 16 08:19:59 user nova-compute[73091]:       <target dev="vdb" bus="virtio"/>
Aug 16 08:19:59 user nova-compute[73091]:       <serial>c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4</serial>
Aug 16 08:19:59 user nova-compute[73091]:     </disk>
Aug 16 08:19:59 user nova-compute[73091]:     <disk type="file" device="disk">
Aug 16 08:19:59 user nova-compute[73091]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 08:19:59 user nova-compute[73091]:       <source file="/opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/disk.rescue"/>
Aug 16 08:19:59 user nova-compute[73091]:       <target dev="vdc" bus="virtio"/>
Aug 16 08:19:59 user nova-compute[73091]:       <boot order="1"/>
Aug 16 08:19:59 user nova-compute[73091]:     </disk>
Aug 16 08:19:59 user nova-compute[73091]:     <interface type="ethernet">
Aug 16 08:19:59 user nova-compute[73091]:       <mac address="fa:16:3e:d1:2f:86"/>
Aug 16 08:19:59 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:19:59 user nova-compute[73091]:       <mtu size="1442"/>
Aug 16 08:19:59 user nova-compute[73091]:       <target dev="tap2334292e-6a"/>
Aug 16 08:19:59 user nova-compute[73091]:     </interface>
Aug 16 08:19:59 user nova-compute[73091]:     <serial type="pty">
Aug 16 08:19:59 user nova-compute[73091]:       <log file="/opt/stack/data/nova/instances/6a927702-8a5e-47d8-99de-b049f20b29a3/console.log" append="off"/>
Aug 16 08:19:59 user nova-compute[73091]:     </serial>
Aug 16 08:19:59 user nova-compute[73091]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 08:19:59 user nova-compute[73091]:     <video>
Aug 16 08:19:59 user nova-compute[73091]:       <model type="virtio"/>
Aug 16 08:19:59 user nova-compute[73091]:     </video>
Aug 16 08:19:59 user nova-compute[73091]:     <rng model="virtio">
Aug 16 08:19:59 user nova-compute[73091]:       <backend model="random">/dev/urandom</backend>
Aug 16 08:19:59 user nova-compute[73091]:     </rng>
Aug 16 08:19:59 user nova-compute[73091]:     <controller type="usb" index="0" model="none"/>
Aug 16 08:19:59 user nova-compute[73091]:     <memballoon model="virtio">
Aug 16 08:19:59 user nova-compute[73091]:       <stats period="10"/>
Aug 16 08:19:59 user nova-compute[73091]:     </memballoon>
Aug 16 08:19:59 user nova-compute[73091]:   </devices>
Aug 16 08:19:59 user nova-compute[73091]: </domain>
Aug 16 08:19:59 user nova-compute[73091]:  {{(pid=73091) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 08:19:59 user nova-compute[73091]: INFO nova.virt.libvirt.driver [-] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Instance destroyed successfully.
Aug 16 08:19:59 user nova-compute[73091]: DEBUG nova.network.neutron [-] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Updating instance_info_cache with network_info: [] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:20:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] No BDM found with device name vda, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:20:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:20:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73091) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 08:20:00 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] No VIF found with MAC fa:16:3e:d1:2f:86, not building metadata {{(pid=73091) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 08:20:00 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Took 0.61 seconds to deallocate network for instance.
Aug 16 08:20:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-db4c76be-56d9-4920-93c2-e99b771a22f5 req-b7cd2a72-bb66-412e-a1d5-75a752ab3900 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Received event network-vif-plugged-4dd5faac-d8ed-41ca-9160-c72beda8f636 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:20:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-db4c76be-56d9-4920-93c2-e99b771a22f5 req-b7cd2a72-bb66-412e-a1d5-75a752ab3900 service nova] Acquiring lock "9a2dd138-1c20-4114-afac-e272aba39537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:20:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-db4c76be-56d9-4920-93c2-e99b771a22f5 req-b7cd2a72-bb66-412e-a1d5-75a752ab3900 service nova] Lock "9a2dd138-1c20-4114-afac-e272aba39537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:20:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-db4c76be-56d9-4920-93c2-e99b771a22f5 req-b7cd2a72-bb66-412e-a1d5-75a752ab3900 service nova] Lock "9a2dd138-1c20-4114-afac-e272aba39537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:20:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-db4c76be-56d9-4920-93c2-e99b771a22f5 req-b7cd2a72-bb66-412e-a1d5-75a752ab3900 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] No waiting events found dispatching network-vif-plugged-4dd5faac-d8ed-41ca-9160-c72beda8f636 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:20:00 user nova-compute[73091]: WARNING nova.compute.manager [req-db4c76be-56d9-4920-93c2-e99b771a22f5 req-b7cd2a72-bb66-412e-a1d5-75a752ab3900 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Received unexpected event network-vif-plugged-4dd5faac-d8ed-41ca-9160-c72beda8f636 for instance with vm_state active and task_state deleting.
Aug 16 08:20:00 user nova-compute[73091]: DEBUG nova.compute.manager [req-db4c76be-56d9-4920-93c2-e99b771a22f5 req-b7cd2a72-bb66-412e-a1d5-75a752ab3900 service nova] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Received event network-vif-deleted-4dd5faac-d8ed-41ca-9160-c72beda8f636 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:20:00 user nova-compute[73091]: INFO nova.compute.manager [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Took 0.74 seconds to detach 1 volumes for instance.
Aug 16 08:20:00 user nova-compute[73091]: DEBUG nova.compute.manager [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Deleting volume: 4d4c5143-c649-4a19-9aea-9189ea42c65d {{(pid=73091) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 08:20:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:20:00 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:20:01 user nova-compute[73091]: INFO nova.scheduler.client.report [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Deleted allocations for instance 9a2dd138-1c20-4114-afac-e272aba39537
Aug 16 08:20:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-8858a203-416a-4496-9372-b6347eac8695 tempest-TestVolumeBootPattern-1306800265 tempest-TestVolumeBootPattern-1306800265-project-member] Lock "9a2dd138-1c20-4114-afac-e272aba39537" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.922s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-fa5d47bb-2c0b-45ef-b0f0-032b18561974 req-30db9fed-cbd3-4e02-9e26-57f77bba9599 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Received event network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fa5d47bb-2c0b-45ef-b0f0-032b18561974 req-30db9fed-cbd3-4e02-9e26-57f77bba9599 service nova] Acquiring lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fa5d47bb-2c0b-45ef-b0f0-032b18561974 req-30db9fed-cbd3-4e02-9e26-57f77bba9599 service nova] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-fa5d47bb-2c0b-45ef-b0f0-032b18561974 req-30db9fed-cbd3-4e02-9e26-57f77bba9599 service nova] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG nova.compute.manager [req-fa5d47bb-2c0b-45ef-b0f0-032b18561974 req-30db9fed-cbd3-4e02-9e26-57f77bba9599 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] No waiting events found dispatching network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:20:01 user nova-compute[73091]: WARNING nova.compute.manager [req-fa5d47bb-2c0b-45ef-b0f0-032b18561974 req-30db9fed-cbd3-4e02-9e26-57f77bba9599 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Received unexpected event network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 for instance with vm_state active and task_state rescuing.
Aug 16 08:20:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Acquiring lock "4bfc7896-7001-48e3-a768-1030c3eb8485" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "4bfc7896-7001-48e3-a768-1030c3eb8485" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:20:01 user nova-compute[73091]: INFO nova.compute.manager [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Detaching volume 616890be-d8a8-42d8-a7e1-5f2fc973b616
Aug 16 08:20:01 user nova-compute[73091]: INFO nova.virt.block_device [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Attempting to driver detach volume 616890be-d8a8-42d8-a7e1-5f2fc973b616 from mountpoint /dev/vdb
Aug 16 08:20:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Attempting to detach device vdb from instance 4bfc7896-7001-48e3-a768-1030c3eb8485 from the persistent domain config. {{(pid=73091) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:20:01 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:20:01 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 08:20:01 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:20:01 user nova-compute[73091]:   <serial>616890be-d8a8-42d8-a7e1-5f2fc973b616</serial>
Aug 16 08:20:01 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 08:20:01 user nova-compute[73091]: </disk>
Aug 16 08:20:01 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:20:01 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Successfully detached device vdb from instance 4bfc7896-7001-48e3-a768-1030c3eb8485 from the persistent domain config.
Aug 16 08:20:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4bfc7896-7001-48e3-a768-1030c3eb8485 from the live domain config. {{(pid=73091) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 08:20:01 user nova-compute[73091]: DEBUG nova.virt.libvirt.guest [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 08:20:01 user nova-compute[73091]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 08:20:01 user nova-compute[73091]:   <source dev="/dev/sdf"/>
Aug 16 08:20:01 user nova-compute[73091]:   <target dev="vdb" bus="virtio"/>
Aug 16 08:20:01 user nova-compute[73091]:   <serial>616890be-d8a8-42d8-a7e1-5f2fc973b616</serial>
Aug 16 08:20:01 user nova-compute[73091]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 08:20:01 user nova-compute[73091]: </disk>
Aug 16 08:20:01 user nova-compute[73091]:  {{(pid=73091) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Received event <DeviceRemovedEvent: 1692174002.397416, 4bfc7896-7001-48e3-a768-1030c3eb8485 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73091) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.driver [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4bfc7896-7001-48e3-a768-1030c3eb8485 {{(pid=73091) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 08:20:02 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Successfully detached device vdb from instance 4bfc7896-7001-48e3-a768-1030c3eb8485 from the live domain config.
Aug 16 08:20:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] calling os-brick to detach iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8f0345240>, {'target_iqns': ['iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCIkXSeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 08:20:02 user nova-compute[73091]: WARNING os_brick.initiator.connectors.base [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616', 0)] {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fec07c-3194-417b-bf4c-94a326777a8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac3fa38-a304-488a-8abe-ac3b1f8587e3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 (non-flash)\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:20:02 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:20:02 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)
Aug 16 08:20:02 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 (non-flash)
Aug 16 08:20:02 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b085feb-a997-40d9-a120-66c7a45b64f5 (non-flash)
Aug 16 08:20:02 user nova-compute[73091]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af77b663-c459-4119-a4c2-fa4822759d05 (non-flash)
Aug 16 08:20:02 user nova-compute[73091]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5bf1ff0-c733-4deb-9065-bdf7df5ae8c4 (non-flash)
Aug 16 08:20:02 user nova-compute[73091]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 (non-flash)
Aug 16 08:20:02 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8f04c8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616'): ({'sdf'}, set())}) {{(pid=73091) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Removing single pathed devices sdf {{(pid=73091) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b51849d-1da7-4027-a31d-9c132a427fda]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8552b5-b52c-41b4-8856-07b1ba611ff2]: (4, ('ok\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Flushing IO for device /dev/sdf {{(pid=73091) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[01073b37-75ed-42d0-b432-4c791abfe218]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73091) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86a9178-3cd1-44cf-810e-d8d7c1ba4ecf]: (4, ('1', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.linuxscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] SCSI volumes sdf have been removed. {{(pid=73091) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616')] {{(pid=73091) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cdd55b-105f-4787-9ee6-7a0eb703ae74]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --logout {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[d923427d-d1d4-4a3c-97b1-88667f437854]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616, portal: 172.16.0.220,3260]
Aug 16 08:20:02 user nova-compute[73091]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616, portal: 172.16.0.220,3260] successful.
Aug 16 08:20:02 user nova-compute[73091]:  stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --op delete {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616890be-d8a8-42d8-a7e1-5f2fc973b616 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83685) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec8ad6a-58f3-4826-b2c6-6199d7f7d67b]: (4, ('', '')) {{(pid=83685) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73091) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.base [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG os_brick.initiator.connectors.iscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] <== disconnect_volume: return (300ms) None {{(pid=73091) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] [instance: 4bfc7896-7001-48e3-a768-1030c3eb8485] Disconnected iSCSI Volume {{(pid=73091) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 08:20:02 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173987.8976643, 935af9fd-600a-4c48-873b-b39126081748 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:20:02 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 935af9fd-600a-4c48-873b-b39126081748] VM Stopped (Lifecycle Event)
Aug 16 08:20:02 user nova-compute[73091]: DEBUG nova.compute.manager [None req-7fd481d4-79d7-471d-9c8c-6a7a7b723ad3 None None] [instance: 935af9fd-600a-4c48-873b-b39126081748] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:20:03 user nova-compute[73091]: DEBUG nova.objects.instance [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lazy-loading 'flavor' on Instance uuid 4bfc7896-7001-48e3-a768-1030c3eb8485 {{(pid=73091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 08:20:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-97eea55f-4a0a-4f5e-9cbf-895e0c5f669d tempest-TestStampPattern-472046926 tempest-TestStampPattern-472046926-project-member] Lock "4bfc7896-7001-48e3-a768-1030c3eb8485" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.729s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:20:03 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:20:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-2e25f4bd-0275-4a48-9b3c-28698eb55edb req-ab284ae1-afb8-45b5-8dfa-d98c654da4f4 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Received event network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:20:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2e25f4bd-0275-4a48-9b3c-28698eb55edb req-ab284ae1-afb8-45b5-8dfa-d98c654da4f4 service nova] Acquiring lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:20:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2e25f4bd-0275-4a48-9b3c-28698eb55edb req-ab284ae1-afb8-45b5-8dfa-d98c654da4f4 service nova] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:20:03 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-2e25f4bd-0275-4a48-9b3c-28698eb55edb req-ab284ae1-afb8-45b5-8dfa-d98c654da4f4 service nova] Lock "6a927702-8a5e-47d8-99de-b049f20b29a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:20:03 user nova-compute[73091]: DEBUG nova.compute.manager [req-2e25f4bd-0275-4a48-9b3c-28698eb55edb req-ab284ae1-afb8-45b5-8dfa-d98c654da4f4 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] No waiting events found dispatching network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 {{(pid=73091) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 08:20:03 user nova-compute[73091]: WARNING nova.compute.manager [req-2e25f4bd-0275-4a48-9b3c-28698eb55edb req-ab284ae1-afb8-45b5-8dfa-d98c654da4f4 service nova] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Received unexpected event network-vif-plugged-2334292e-6adb-4800-a26e-26c91045e0f2 for instance with vm_state active and task_state rescuing.
Aug 16 08:20:04 user nova-compute[73091]: DEBUG nova.virt.libvirt.host [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Removed pending event for 6a927702-8a5e-47d8-99de-b049f20b29a3 due to event {{(pid=73091) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 08:20:04 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692174004.0440397, 6a927702-8a5e-47d8-99de-b049f20b29a3 => Resumed> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:20:04 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] VM Resumed (Lifecycle Event)
Aug 16 08:20:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-d72c0a56-d2c9-45b7-8542-7ac8fd22e431 tempest-ServerStableDeviceRescueTest-2133277169 tempest-ServerStableDeviceRescueTest-2133277169-project-member] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:20:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:20:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:20:04 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 08:20:04 user nova-compute[73091]: DEBUG nova.virt.driver [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] Emitting event <LifecycleEvent: 1692174004.0464804, 6a927702-8a5e-47d8-99de-b049f20b29a3 => Started> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:20:04 user nova-compute[73091]: INFO nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] VM Started (Lifecycle Event)
Aug 16 08:20:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:20:04 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a12ed9ca-a251-4463-ba36-2521ced5a783 None None] [instance: 6a927702-8a5e-47d8-99de-b049f20b29a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73091) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 08:20:04 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:20:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "09fef5c3-29a6-4a59-a88f-df828c87163c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:20:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "09fef5c3-29a6-4a59-a88f-df828c87163c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:20:05 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Starting instance... {{(pid=73091) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 08:20:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:20:05 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:20:05 user nova-compute[73091]: DEBUG nova.virt.hardware [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73091) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 08:20:05 user nova-compute[73091]: INFO nova.compute.claims [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Claim successful on node user
Aug 16 08:20:06 user nova-compute[73091]: DEBUG nova.compute.provider_tree [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Inventory has not changed in ProviderTree for provider: a5935d1e-4613-4ec5-92d3-58605923e4b9 {{(pid=73091) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 08:20:06 user nova-compute[73091]: DEBUG nova.scheduler.client.report [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Inventory has not changed for provider a5935d1e-4613-4ec5-92d3-58605923e4b9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73091) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 08:20:06 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:20:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Start building networks asynchronously for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 08:20:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Allocating IP information in the background. {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 08:20:06 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] allocate_for_instance() {{(pid=73091) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 08:20:06 user nova-compute[73091]: INFO nova.virt.libvirt.driver [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 08:20:06 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Start building block device mappings for instance. {{(pid=73091) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 08:20:06 user nova-compute[73091]: DEBUG nova.policy [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '196d845c007043b3aead43d76d94df07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85ea39234954b05a5a5b21cc52b30ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73091) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 08:20:06 user nova-compute[73091]: INFO nova.virt.block_device [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Booting with volume-backed-image 9c570403-184d-4d84-97e0-b6d49d2e29e7 at /dev/vda
Aug 16 08:20:07 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Successfully created port: 1b49b4ca-0227-4f9a-8d09-acd4dc6a6d48 {{(pid=73091) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 08:20:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Successfully updated port: 1b49b4ca-0227-4f9a-8d09-acd4dc6a6d48 {{(pid=73091) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 08:20:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquiring lock "refresh_cache-09fef5c3-29a6-4a59-a88f-df828c87163c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:20:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Acquired lock "refresh_cache-09fef5c3-29a6-4a59-a88f-df828c87163c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:20:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Building network info cache for instance {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 08:20:08 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:20:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-6e211108-ff4b-4160-832d-7bf18bd3eb3c req-63e6e4c1-2218-49eb-997b-35f16dc69bce service nova] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Received event network-changed-1b49b4ca-0227-4f9a-8d09-acd4dc6a6d48 {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 08:20:08 user nova-compute[73091]: DEBUG nova.compute.manager [req-6e211108-ff4b-4160-832d-7bf18bd3eb3c req-63e6e4c1-2218-49eb-997b-35f16dc69bce service nova] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Refreshing instance network info cache due to event network-changed-1b49b4ca-0227-4f9a-8d09-acd4dc6a6d48. {{(pid=73091) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 08:20:08 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e211108-ff4b-4160-832d-7bf18bd3eb3c req-63e6e4c1-2218-49eb-997b-35f16dc69bce service nova] Acquiring lock "refresh_cache-09fef5c3-29a6-4a59-a88f-df828c87163c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 08:20:08 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Instance cache missing network info. {{(pid=73091) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 08:20:09 user nova-compute[73091]: DEBUG nova.network.neutron [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Updating instance_info_cache with network_info: [{"id": "1b49b4ca-0227-4f9a-8d09-acd4dc6a6d48", "address": "fa:16:3e:8a:c1:a2", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b49b4ca-02", "ovs_interfaceid": "1b49b4ca-0227-4f9a-8d09-acd4dc6a6d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:20:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] Releasing lock "refresh_cache-09fef5c3-29a6-4a59-a88f-df828c87163c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:20:09 user nova-compute[73091]: DEBUG nova.compute.manager [None req-6969ee4e-bdb4-478d-adc4-a4eba539e000 tempest-ServerBootFromVolumeStableRescueTest-1623646564 tempest-ServerBootFromVolumeStableRescueTest-1623646564-project-member] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Instance network_info: |[{"id": "1b49b4ca-0227-4f9a-8d09-acd4dc6a6d48", "address": "fa:16:3e:8a:c1:a2", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b49b4ca-02", "ovs_interfaceid": "1b49b4ca-0227-4f9a-8d09-acd4dc6a6d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73091) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 08:20:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e211108-ff4b-4160-832d-7bf18bd3eb3c req-63e6e4c1-2218-49eb-997b-35f16dc69bce service nova] Acquired lock "refresh_cache-09fef5c3-29a6-4a59-a88f-df828c87163c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 08:20:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-6e211108-ff4b-4160-832d-7bf18bd3eb3c req-63e6e4c1-2218-49eb-997b-35f16dc69bce service nova] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Refreshing network info cache for port 1b49b4ca-0227-4f9a-8d09-acd4dc6a6d48 {{(pid=73091) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 08:20:09 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:20:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-6e211108-ff4b-4160-832d-7bf18bd3eb3c req-63e6e4c1-2218-49eb-997b-35f16dc69bce service nova] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Updated VIF entry in instance network info cache for port 1b49b4ca-0227-4f9a-8d09-acd4dc6a6d48. {{(pid=73091) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 08:20:09 user nova-compute[73091]: DEBUG nova.network.neutron [req-6e211108-ff4b-4160-832d-7bf18bd3eb3c req-63e6e4c1-2218-49eb-997b-35f16dc69bce service nova] [instance: 09fef5c3-29a6-4a59-a88f-df828c87163c] Updating instance_info_cache with network_info: [{"id": "1b49b4ca-0227-4f9a-8d09-acd4dc6a6d48", "address": "fa:16:3e:8a:c1:a2", "network": {"id": "231d0163-8e3c-408f-bc7d-92a34ba1fde3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2136347796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c85ea39234954b05a5a5b21cc52b30ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b49b4ca-02", "ovs_interfaceid": "1b49b4ca-0227-4f9a-8d09-acd4dc6a6d48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73091) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 08:20:09 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [req-6e211108-ff4b-4160-832d-7bf18bd3eb3c req-63e6e4c1-2218-49eb-997b-35f16dc69bce service nova] Releasing lock "refresh_cache-09fef5c3-29a6-4a59-a88f-df828c87163c" {{(pid=73091) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 08:20:13 user nova-compute[73091]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692173998.3490305, 9a2dd138-1c20-4114-afac-e272aba39537 => Stopped> {{(pid=73091) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 08:20:13 user nova-compute[73091]: INFO nova.compute.manager [-] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] VM Stopped (Lifecycle Event)
Aug 16 08:20:13 user nova-compute[73091]: DEBUG nova.compute.manager [None req-acbde298-a593-4cb1-8bc7-08f239d26555 None None] [instance: 9a2dd138-1c20-4114-afac-e272aba39537] Checking state {{(pid=73091) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 08:20:13 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:20:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 08:20:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:20:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73091) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 08:20:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 08:20:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73091) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 08:20:18 user nova-compute[73091]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73091) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 08:20:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a21a3887-4d52-4a6b-8017-8b0be639c271 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:20:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a21a3887-4d52-4a6b-8017-8b0be639c271 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:20:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a21a3887-4d52-4a6b-8017-8b0be639c271 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Acquiring lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 08:20:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a21a3887-4d52-4a6b-8017-8b0be639c271 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 08:20:19 user nova-compute[73091]: DEBUG oslo_concurrency.lockutils [None req-a21a3887-4d52-4a6b-8017-8b0be639c271 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] Lock "a79098c3-784e-4315-8fd0-0ff883d4f6e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73091) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 08:20:19 user nova-compute[73091]: INFO nova.compute.manager [None req-a21a3887-4d52-4a6b-8017-8b0be639c271 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Terminating instance
Aug 16 08:20:19 user nova-compute[73091]: DEBUG nova.compute.manager [None req-a21a3887-4d52-4a6b-8017-8b0be639c271 tempest-TestServerVolumeAttachmentScenario-532805896 tempest-TestServerVolumeAttachmentScenario-532805896-project-member] [instance: a79098c3-784e-4315-8fd0-0ff883d4f6e3] Start destroying the instance on the hypervisor. {{(pid=73091) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}